2024-09-12T01:47:30.497 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:47:30.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:47:30.631 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901581' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvn0UKq6fkYMuAvRz/+Vh89xFFqdiVybyofi4AHHJ1ZN4Zkj+elM3vnkkXaeAcP1QmPzI+yDKxL70QxsNfsDR0= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOA2bASPC74MBJv7dYkZbeXZYfgxZGMo8KmoO3vlBxuj6UWyXInYXdyIg8/5QgWneJkiY5V5xEuBcSF8B7M/q14= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6efQBiSRyP6bipSpMAeTyPqbxMwQBn87hRlTQZwutmlY/KOIQ053d37cUN/xxZwYrEYErL+76gEnIs3TbHCCA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:47:30.631 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:47:30.632 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:47:30.632 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:47:30.634 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:47:30.656 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:47:30.656 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:47:30.657 INFO:teuthology.packaging:ref: None 2024-09-12T01:47:30.657 INFO:teuthology.packaging:tag: None 2024-09-12T01:47:30.657 INFO:teuthology.packaging:branch: squid 2024-09-12T01:47:30.657 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:30.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:47:30.874 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:47:30.875 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:47:30.882 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:47:30.882 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:47:30.898 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:47:30.918 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:47:30.926 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:47:30.961 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:42:16.091931', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvn0UKq6fkYMuAvRz/+Vh89xFFqdiVybyofi4AHHJ1ZN4Zkj+elM3vnkkXaeAcP1QmPzI+yDKxL70QxsNfsDR0='} 2024-09-12T01:47:30.994 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:42:16.093924', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOA2bASPC74MBJv7dYkZbeXZYfgxZGMo8KmoO3vlBxuj6UWyXInYXdyIg8/5QgWneJkiY5V5xEuBcSF8B7M/q14='} 2024-09-12T01:47:31.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:42:16.095439', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6efQBiSRyP6bipSpMAeTyPqbxMwQBn87hRlTQZwutmlY/KOIQ053d37cUN/xxZwYrEYErL+76gEnIs3TbHCCA='} 2024-09-12T01:47:31.025 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:47:31.032 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T01:47:31.032 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T01:47:31.033 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T01:47:31.033 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:47:31.147 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde2cc57490>, signals=[15]) 2024-09-12T01:47:31.148 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:47:31.154 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:47:31.154 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T01:47:31.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:47:31.239 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T01:47:31.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:47:31.321 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-12T01:47:31.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:47:31.405 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:47:31.412 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-12T01:47:31.432 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-12T01:47:31.432 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-12T01:47:31.491 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-12T01:47:31.491 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-12T01:47:31.491 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-12T01:47:31.492 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:47:31.492 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-12T01:47:31.492 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:47:31.492 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:47:31.492 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-12T01:47:31.492 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:47:31.492 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:47:31.493 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:47:31.493 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:47:31.493 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:47:31.493 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:47:31.494 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-12T01:47:31.532 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-12T01:47:31.551 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-12T01:47:31.551 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-12T01:47:31.609 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-12T01:47:31.609 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-12T01:47:31.609 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-12T01:47:31.609 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:47:31.609 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-12T01:47:31.609 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:47:31.610 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:47:31.610 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-12T01:47:31.649 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-12T01:47:31.667 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-12T01:47:31.668 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-12T01:47:31.725 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:47:31.726 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:47:31.727 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:47:31.727 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-12T01:47:31.765 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:47:31.775 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:47:31.782 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:47:31.782 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:47:31.785 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:47:31.788 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:47:31.804 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:47:31.811 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:47:31.811 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:47:31.843 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:47:31.846 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:47:32.097 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:47:32.201 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:47:32.216 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:47:32.216 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T01:47:32.216 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T01:47:32.216 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:47:32.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:47:32.234 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-12T01:47:32.291 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:47:32.292 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-503.el9.x86_64 2024-09-12T01:47:32.292 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-09-12T01:47:35.755 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-12T01:47:37.614 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-12T01:47:43.040 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-12T01:47:44.940 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-12T01:47:46.078 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-12T01:47:51.542 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T01:47:53.599 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:47:53.599 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:47:53.694 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-12T01:47:53.701 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-12T01:47:53.701 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-12T01:47:53.701 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-12T01:47:53.701 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 79 M 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 126 M 2024-09-12T01:47:53.702 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-12T01:47:53.927 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 206 kB/s | 23 kB 00:00 2024-09-12T01:47:54.552 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-12T01:47:54.911 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 29 MB/s | 29 MB 00:00 2024-09-12T01:47:58.610 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 7.2 MB/s | 35 MB 00:04 2024-09-12T01:47:58.611 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:47:58.611 INFO:teuthology.orchestra.run.smithi100.stdout:Total 16 MB/s | 79 MB 00:04 2024-09-12T01:47:59.291 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-12T01:47:59.623 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-12T01:47:59.623 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-12T01:48:00.568 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-12T01:48:00.568 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-12T01:48:03.025 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-12T01:48:03.728 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:48:03.811 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:48:06.610 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:48:06.741 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:48:11.570 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:48:11.699 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:48:16.544 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:48:54.857 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:48:54.895 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:48:55.263 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:48:55.263 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:48:55.263 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:48:55.264 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:48:56.087 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-12T01:48:56.436 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:48:56.529 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:48:56.529 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:48:56.530 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:48:56.530 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:48:56.530 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:48:56.530 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T01:48:56.530 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:48:56.530 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:48:56.589 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:48:56.589 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:48:56.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-12T01:48:56.621 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:48:56.622 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:48:56.623 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:48:56.624 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:48:56.624 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:48:56.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:48:57.288 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-12T01:48:58.660 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:48:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-12T01:48:58.695 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-12T01:48:58.710 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.sQAyN7ib8K 2024-09-12T01:48:58.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sQAyN7ib8K 2024-09-12T01:48:58.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.sQAyN7ib8K 2024-09-12T01:48:58.934 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.sQAyN7ib8K is 6KB 2024-09-12T01:48:58.983 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.sQAyN7ib8K 2024-09-12T01:48:58.997 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:48:59.067 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:48:59.067 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:48:59.067 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:48:59.068 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:48:59.069 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:48:59.223 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-12T01:49:29.227 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:49:29.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:49:29.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:50:03.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-12T01:50:12.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:50:12.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:50:31.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-12T01:50:43.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:50:43.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:50:43.536 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-12T01:50:43.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:50:43.938 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:50:43.938 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-12T01:50:43.953 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:50:43.953 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:50:43.953 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:50:43.953 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:50:44.956 DEBUG:teuthology.parallel:result is None 2024-09-12T01:50:44.956 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:50:44.982 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:50:44.983 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:50:44.986 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:50:44.989 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:50:45.010 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:50:45.018 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:50:45.046 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:50:45.046 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:50:45.049 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:50:45.051 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:50:45.191 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:50:45.200 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:50:45.200 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:50:45.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:50:45.218 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:50:45.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:50:45.236 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:50:45.239 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:50:45.260 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:50:45.308 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:50:45.323 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:50:45.336 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:50:45.356 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:50:45.365 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:50:45.493 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:50:45.495 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:50:45.505 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:50:45.505 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:50:45.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:50:45.510 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:50:45.541 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:50:45.549 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:50:45.549 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:50:45.574 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:50:45.581 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:50:45.599 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:50:45.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:50:45.766 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:50:45.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:50:45.895 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:50:45.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:50:45.943 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:50:45.998 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:50:46.042 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:50:46.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:50:46.171 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:50:46.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:50:46.238 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:50:46.293 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:50:46.341 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:50:46.433 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:50:46.470 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:50:46.470 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:50:46.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-12T01:50:46.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-12T01:50:46.544 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-12T01:50:46.580 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:50:46.619 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:50:46.655 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:50:47.127 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:50:47.134 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:50:47.134 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:50:47.154 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:50:47.161 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:50:47.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-12T01:50:47.291 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-12T01:50:47.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-12T01:50:47.338 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-12T01:50:47.340 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-12T01:50:47.391 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-12T01:50:47.393 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:50:47.393 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-12T01:50:47.467 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-12T01:50:47.468 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-12T01:50:47.497 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-12T01:50:47.497 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-12T01:50:47.525 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-12T01:50:47.526 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:50:47.526 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:50:47.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:50:47.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:50:47.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:50:47.579 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:50:47.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:50:47.608 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:50:47.608 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:50:47.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:50:47.694 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:50:47.728 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:50:47.737 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:50:47.749 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:50:47.750 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi117.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:54:50.018 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-12T01:54:50.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:54:50.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:54:50.109 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-12T01:54:50.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:54:50.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T01:54:50.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:54:50.268 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T01:54:50.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-12T01:54:50.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:54:50.435 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-12T01:54:50.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-12T01:54:50.519 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:54:50.530 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:54:50.531 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:54:50.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:54:50.535 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:54:50.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:54:50.537 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:54:50.538 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:54:50.564 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:54:50.565 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:54:50.578 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:54:50.580 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:54:50.591 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:54:50.602 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-12T01:54:50.606 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:54:50.607 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-12T01:54:50.613 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-12T01:54:50.619 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-12T01:54:50.627 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:54:50.632 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-12T01:54:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:54:50.641 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:54:50.644 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-12T01:54:50.648 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:54:50.658 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:54:50.673 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:54:50.694 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:54:50.698 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:54:50.698 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T01:54:50.698 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.698 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.699 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.699 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:54:50.710 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:54:50.710 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-12T01:54:50.710 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.710 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.711 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.711 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.729 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:54:50.734 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:54:50.734 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-12T01:54:50.735 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.735 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.735 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.736 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:54:50.736 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:54:50.748 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:54:50.748 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:54:50.748 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:54:50.748 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:54:50.757 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:54:50.758 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T01:54:50.760 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:54:50.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:54:50.762 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:54:50.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:54:50.764 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:54:50.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:54:50.927 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:54:50.927 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:54:50.941 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:54:50.941 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:54:50.942 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:54:50.942 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:54:51.049 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:54:51.049 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:54:51.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:54:51.058 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:54:51.059 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:54:51.059 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:54:51.068 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:54:51.068 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:54:51.068 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:54:51.075 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:54:51.075 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:54:51.085 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:54:51.085 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:54:51.094 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:54:51.094 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:54:51.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:54:51.153 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:54:51.161 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:54:51.216 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:54:51.229 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:54:51.237 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:54:51.279 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-12T01:54:51.281 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-12T01:54:51.294 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-12T01:54:51.295 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-12T01:54:51.301 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-12T01:54:51.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-12T01:54:51.511 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-12T01:54:51.523 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-12T01:54:51.528 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-12T01:54:51.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:54:51.551 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:54:51.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:54:52.089 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 325 kB/s | 84 kB 00:00 2024-09-12T01:54:52.095 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-12T01:54:52.356 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-12T01:54:52.376 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:54:52.379 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T01:54:52.615 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-12T01:54:52.643 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T01:54:52.646 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T01:54:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T01:54:53.238 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-12T01:54:54.134 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.2 MB 00:01 2024-09-12T01:54:56.519 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-12T01:54:57.943 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 20 MB 00:03 2024-09-12T01:54:58.231 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-09-12T01:55:00.778 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T01:55:02.161 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-12T01:55:02.304 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-12T01:55:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-12T01:55:04.406 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-12T01:55:04.940 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-12T01:55:05.166 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T01:55:06.374 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 19 kB 00:00 2024-09-12T01:55:07.561 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T01:55:09.021 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-12T01:55:10.555 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T01:55:11.275 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:55:11.275 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:55:11.288 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:55:11.289 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:55:11.290 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:55:11.291 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:55:11.293 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:55:11.296 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:55:11.297 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:55:11.358 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:55:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:55:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:55:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:55:11.371 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:55:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:55:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:55:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:55:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:55:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:55:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:55:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:55:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:55:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-12T01:55:11.381 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T01:55:11.382 INFO:teuthology.orchestra.run.smithi117.stdout:Install 148 Packages 2024-09-12T01:55:11.382 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 8 Packages 2024-09-12T01:55:11.382 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:55:11.382 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 226 M 2024-09-12T01:55:11.382 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-12T01:55:12.297 INFO:teuthology.orchestra.run.smithi117.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-12T01:55:12.481 INFO:teuthology.orchestra.run.smithi117.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.8 MB/s | 897 kB 00:00 2024-09-12T01:55:12.565 INFO:teuthology.orchestra.run.smithi117.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.7 MB/s | 145 kB 00:00 2024-09-12T01:55:12.648 INFO:teuthology.orchestra.run.smithi117.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T01:55:12.774 INFO:teuthology.orchestra.run.smithi117.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-12T01:55:12.815 INFO:teuthology.orchestra.run.smithi117.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-12T01:55:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:55:12.874 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:55:12.885 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:55:12.886 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:55:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:55:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:55:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:55:12.892 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:55:12.893 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:55:12.955 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-12T01:55:12.973 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T01:55:12.973 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-12T01:55:12.973 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T01:55:12.973 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-12T01:55:12.973 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:55:12.973 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:55:12.973 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:55:12.974 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:55:12.974 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:55:12.974 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:55:12.975 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:55:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:55:12.977 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:55:12.978 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:55:12.979 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:55:12.980 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:55:12.981 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:55:12.982 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:55:12.983 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:55:12.984 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:55:12.985 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:55:12.985 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:55:12.985 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:55:12.985 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:55:12.985 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:55:12.985 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:55:12.986 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:55:12.986 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:55:12.986 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:55:12.986 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:55:12.986 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:55:12.986 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:55:12.987 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-12T01:55:12.988 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:55:12.988 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:55:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-12T01:55:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T01:55:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-09-12T01:55:12.988 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-12T01:55:12.988 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:55:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-09-12T01:55:12.989 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-12T01:55:13.142 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T01:55:13.391 INFO:teuthology.orchestra.run.smithi117.stdout:(7/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T01:55:13.466 INFO:teuthology.orchestra.run.smithi117.stdout:(8/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 6.8 MB/s | 4.7 MB 00:00 2024-09-12T01:55:13.472 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-12T01:55:13.508 INFO:teuthology.orchestra.run.smithi117.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 606 kB/s | 25 kB 00:00 2024-09-12T01:55:13.898 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.1 MB/s | 897 kB 00:00 2024-09-12T01:55:13.925 INFO:teuthology.orchestra.run.smithi117.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 15 MB/s | 17 MB 00:01 2024-09-12T01:55:13.956 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.4 MB/s | 145 kB 00:00 2024-09-12T01:55:14.000 INFO:teuthology.orchestra.run.smithi117.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.0 MB/s | 228 kB 00:00 2024-09-12T01:55:14.167 INFO:teuthology.orchestra.run.smithi117.stdout:(12/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 14 MB/s | 11 MB 00:00 2024-09-12T01:55:14.192 INFO:teuthology.orchestra.run.smithi117.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 141 kB/s | 27 kB 00:00 2024-09-12T01:55:14.198 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.2 MB/s | 5.4 MB 00:00 2024-09-12T01:55:14.217 INFO:teuthology.orchestra.run.smithi117.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 635 kB/s | 32 kB 00:00 2024-09-12T01:55:14.259 INFO:teuthology.orchestra.run.smithi117.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 752 kB 00:00 2024-09-12T01:55:14.284 INFO:teuthology.orchestra.run.smithi117.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T01:55:14.326 INFO:teuthology.orchestra.run.smithi117.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T01:55:14.365 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-12T01:55:14.368 INFO:teuthology.orchestra.run.smithi117.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-12T01:55:14.452 INFO:teuthology.orchestra.run.smithi117.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 541 kB/s | 45 kB 00:00 2024-09-12T01:55:14.535 INFO:teuthology.orchestra.run.smithi117.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T01:55:14.599 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.7 MB/s | 2.4 MB 00:00 2024-09-12T01:55:14.619 INFO:teuthology.orchestra.run.smithi117.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-12T01:55:14.711 INFO:teuthology.orchestra.run.smithi117.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 321 kB 00:00 2024-09-12T01:55:14.786 INFO:teuthology.orchestra.run.smithi117.stdout:(23/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-12T01:55:14.812 INFO:teuthology.orchestra.run.smithi117.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 301 kB 00:00 2024-09-12T01:55:14.816 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-12T01:55:14.837 INFO:teuthology.orchestra.run.smithi117.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T01:55:14.879 INFO:teuthology.orchestra.run.smithi117.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-12T01:55:14.979 INFO:teuthology.orchestra.run.smithi117.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-12T01:55:15.089 INFO:teuthology.orchestra.run.smithi117.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 294 kB/s | 32 kB 00:00 2024-09-12T01:55:15.163 INFO:teuthology.orchestra.run.smithi117.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 9.5 MB/s | 3.1 MB 00:00 2024-09-12T01:55:15.189 INFO:teuthology.orchestra.run.smithi117.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.4 MB/s | 146 kB 00:00 2024-09-12T01:55:15.428 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:55:15.428 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:55:15.439 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:55:15.440 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:55:15.441 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:55:15.442 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:55:15.443 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:55:15.445 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:55:15.446 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:55:15.509 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-12T01:55:15.528 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:55:15.529 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:55:15.530 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:55:15.531 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:55:15.532 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:55:15.533 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:55:15.534 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:55:15.535 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:55:15.536 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:55:15.537 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:55:15.538 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:55:15.539 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:55:15.540 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:55:15.541 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:55:15.542 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:55:15.543 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:55:15.544 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-12T01:55:15.544 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T01:55:15.544 INFO:teuthology.orchestra.run.smithi189.stdout:Install 148 Packages 2024-09-12T01:55:15.544 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-12T01:55:15.544 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:55:15.544 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 226 M 2024-09-12T01:55:15.545 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-12T01:55:15.572 INFO:teuthology.orchestra.run.smithi117.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 8.7 MB/s | 3.6 MB 00:00 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi117.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-12T01:55:15.674 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 12 MB/s | 11 MB 00:00 2024-09-12T01:55:15.706 INFO:teuthology.orchestra.run.smithi117.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 739 kB/s | 49 kB 00:00 2024-09-12T01:55:15.773 INFO:teuthology.orchestra.run.smithi117.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 247 kB/s | 16 kB 00:00 2024-09-12T01:55:15.840 INFO:teuthology.orchestra.run.smithi117.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T01:55:15.908 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 8.2 MB/s | 21 MB 00:02 2024-09-12T01:55:15.933 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 97 kB/s | 25 kB 00:00 2024-09-12T01:55:15.992 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:55:15.998 INFO:teuthology.orchestra.run.smithi117.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 9.1 MB/s | 7.4 MB 00:00 2024-09-12T01:55:16.024 INFO:teuthology.orchestra.run.smithi117.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-12T01:55:16.057 INFO:teuthology.orchestra.run.smithi117.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-12T01:55:16.058 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 406 kB/s | 27 kB 00:00 2024-09-12T01:55:16.117 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 544 kB/s | 32 kB 00:00 2024-09-12T01:55:16.193 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-12T01:55:16.251 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T01:55:16.301 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:55:16.369 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T01:55:16.535 INFO:teuthology.orchestra.run.smithi189.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2024-09-12T01:55:16.624 INFO:teuthology.orchestra.run.smithi117.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 16 MB/s | 49 MB 00:03 2024-09-12T01:55:16.649 INFO:teuthology.orchestra.run.smithi117.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 128 kB/s | 80 kB 00:00 2024-09-12T01:55:16.677 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-12T01:55:16.708 INFO:teuthology.orchestra.run.smithi117.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-12T01:55:16.742 INFO:teuthology.orchestra.run.smithi117.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-12T01:55:16.752 INFO:teuthology.orchestra.run.smithi189.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.0 MB/s | 897 kB 00:00 2024-09-12T01:55:16.760 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 542 kB/s | 45 kB 00:00 2024-09-12T01:55:16.767 INFO:teuthology.orchestra.run.smithi117.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-12T01:55:16.834 INFO:teuthology.orchestra.run.smithi117.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-12T01:55:16.844 INFO:teuthology.orchestra.run.smithi189.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T01:55:16.853 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-12T01:55:16.884 INFO:teuthology.orchestra.run.smithi117.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T01:55:16.926 INFO:teuthology.orchestra.run.smithi117.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-09-12T01:55:16.951 INFO:teuthology.orchestra.run.smithi117.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T01:55:16.986 INFO:teuthology.orchestra.run.smithi189.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 8.7 MB/s | 5.4 MB 00:00 2024-09-12T01:55:17.001 INFO:teuthology.orchestra.run.smithi117.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-12T01:55:17.060 INFO:teuthology.orchestra.run.smithi117.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-09-12T01:55:17.086 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 6.8 MB/s | 17 MB 00:02 2024-09-12T01:55:17.094 INFO:teuthology.orchestra.run.smithi117.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-12T01:55:17.111 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 627 kB/s | 162 kB 00:00 2024-09-12T01:55:17.127 INFO:teuthology.orchestra.run.smithi117.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 943 kB 00:00 2024-09-12T01:55:17.145 INFO:teuthology.orchestra.run.smithi189.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 7.9 MB/s | 2.4 MB 00:00 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi117.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-12T01:55:17.186 INFO:teuthology.orchestra.run.smithi189.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-12T01:55:17.187 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.1 MB/s | 321 kB 00:00 2024-09-12T01:55:17.204 INFO:teuthology.orchestra.run.smithi117.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 429 kB/s | 33 kB 00:00 2024-09-12T01:55:17.212 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 301 kB 00:00 2024-09-12T01:55:17.272 INFO:teuthology.orchestra.run.smithi117.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-09-12T01:55:17.304 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 853 kB/s | 100 kB 00:00 2024-09-12T01:55:17.313 INFO:teuthology.orchestra.run.smithi117.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-12T01:55:17.338 INFO:teuthology.orchestra.run.smithi117.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 170 kB/s | 11 kB 00:00 2024-09-12T01:55:17.414 INFO:teuthology.orchestra.run.smithi117.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-12T01:55:17.439 INFO:teuthology.orchestra.run.smithi117.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-09-12T01:55:17.481 INFO:teuthology.orchestra.run.smithi117.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 958 kB/s | 160 kB 00:00 2024-09-12T01:55:17.539 INFO:teuthology.orchestra.run.smithi117.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 421 kB/s | 24 kB 00:00 2024-09-12T01:55:17.573 INFO:teuthology.orchestra.run.smithi117.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-12T01:55:17.598 INFO:teuthology.orchestra.run.smithi117.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-12T01:55:17.632 INFO:teuthology.orchestra.run.smithi117.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-09-12T01:55:17.682 INFO:teuthology.orchestra.run.smithi117.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-12T01:55:17.687 INFO:teuthology.orchestra.run.smithi189.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.7 MB/s | 4.7 MB 00:00 2024-09-12T01:55:17.708 INFO:teuthology.orchestra.run.smithi117.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 512 kB/s | 38 kB 00:00 2024-09-12T01:55:17.733 INFO:teuthology.orchestra.run.smithi117.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-12T01:55:17.754 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 157 kB/s | 85 kB 00:00 2024-09-12T01:55:17.813 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-12T01:55:17.880 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 478 kB/s | 32 kB 00:00 2024-09-12T01:55:17.900 INFO:teuthology.orchestra.run.smithi117.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-12T01:55:17.920 INFO:teuthology.orchestra.run.smithi189.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 21 MB 00:01 2024-09-12T01:55:17.947 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.1 MB/s | 146 kB 00:00 2024-09-12T01:55:17.979 INFO:teuthology.orchestra.run.smithi189.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 434 kB/s | 25 kB 00:00 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 4.5 MB/s | 3.1 MB 00:00 2024-09-12T01:55:18.017 INFO:teuthology.orchestra.run.smithi117.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-12T01:55:18.083 INFO:teuthology.orchestra.run.smithi117.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-12T01:55:18.175 INFO:teuthology.orchestra.run.smithi117.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 868 kB/s | 137 kB 00:00 2024-09-12T01:55:18.276 INFO:teuthology.orchestra.run.smithi117.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 8.3 MB/s | 4.9 MB 00:00 2024-09-12T01:55:18.351 INFO:teuthology.orchestra.run.smithi117.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T01:55:18.385 INFO:teuthology.orchestra.run.smithi117.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-09-12T01:55:18.422 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.5 MB/s | 3.6 MB 00:00 2024-09-12T01:55:18.451 INFO:teuthology.orchestra.run.smithi117.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 922 kB/s | 61 kB 00:00 2024-09-12T01:55:18.481 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-12T01:55:18.539 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 846 kB/s | 49 kB 00:00 2024-09-12T01:55:18.545 INFO:teuthology.orchestra.run.smithi189.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 17 MB 00:01 2024-09-12T01:55:18.607 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 246 kB/s | 16 kB 00:00 2024-09-12T01:55:18.629 INFO:teuthology.orchestra.run.smithi189.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 228 kB 00:00 2024-09-12T01:55:18.660 INFO:teuthology.orchestra.run.smithi117.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-12T01:55:18.690 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.3 MB/s | 285 kB 00:00 2024-09-12T01:55:18.713 INFO:teuthology.orchestra.run.smithi189.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 325 kB/s | 27 kB 00:00 2024-09-12T01:55:18.805 INFO:teuthology.orchestra.run.smithi189.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 346 kB/s | 32 kB 00:00 2024-09-12T01:55:18.910 INFO:teuthology.orchestra.run.smithi117.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 993 kB/s | 248 kB 00:00 2024-09-12T01:55:18.925 INFO:teuthology.orchestra.run.smithi189.stdout:(14/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 8.6 MB/s | 11 MB 00:01 2024-09-12T01:55:18.963 INFO:teuthology.orchestra.run.smithi189.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.6 MB/s | 752 kB 00:00 2024-09-12T01:55:18.986 INFO:teuthology.orchestra.run.smithi117.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 6.4 MB/s | 5.8 MB 00:00 2024-09-12T01:55:18.989 INFO:teuthology.orchestra.run.smithi189.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T01:55:19.014 INFO:teuthology.orchestra.run.smithi189.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 127 kB 00:00 2024-09-12T01:55:19.048 INFO:teuthology.orchestra.run.smithi189.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.4 MB/s | 506 kB 00:00 2024-09-12T01:55:19.077 INFO:teuthology.orchestra.run.smithi117.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 8.2 MB/s | 6.0 MB 00:00 2024-09-12T01:55:19.090 INFO:teuthology.orchestra.run.smithi189.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 1.1 MB/s | 45 kB 00:00 2024-09-12T01:55:19.094 INFO:teuthology.orchestra.run.smithi117.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 139 kB/s | 26 kB 00:00 2024-09-12T01:55:19.111 INFO:teuthology.orchestra.run.smithi117.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-09-12T01:55:19.157 INFO:teuthology.orchestra.run.smithi189.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-12T01:55:19.161 INFO:teuthology.orchestra.run.smithi117.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-09-12T01:55:19.187 INFO:teuthology.orchestra.run.smithi117.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-12T01:55:19.216 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 15 MB/s | 49 MB 00:03 2024-09-12T01:55:19.224 INFO:teuthology.orchestra.run.smithi189.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-12T01:55:19.241 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-12T01:55:19.274 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 313 kB/s | 18 kB 00:00 2024-09-12T01:55:19.295 INFO:teuthology.orchestra.run.smithi117.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-12T01:55:19.321 INFO:teuthology.orchestra.run.smithi117.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-12T01:55:19.341 INFO:teuthology.orchestra.run.smithi189.stdout:(22/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-12T01:55:19.374 INFO:teuthology.orchestra.run.smithi189.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 321 kB 00:00 2024-09-12T01:55:19.391 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-12T01:55:19.396 INFO:teuthology.orchestra.run.smithi117.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 768 kB/s | 77 kB 00:00 2024-09-12T01:55:19.400 INFO:teuthology.orchestra.run.smithi189.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T01:55:19.422 INFO:teuthology.orchestra.run.smithi117.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 420 kB/s | 42 kB 00:00 2024-09-12T01:55:19.425 INFO:teuthology.orchestra.run.smithi189.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T01:55:19.450 INFO:teuthology.orchestra.run.smithi189.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T01:55:19.483 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 5.0 MB/s | 7.4 MB 00:01 2024-09-12T01:55:19.500 INFO:teuthology.orchestra.run.smithi189.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T01:55:19.513 INFO:teuthology.orchestra.run.smithi117.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-12T01:55:19.517 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-12T01:55:19.539 INFO:teuthology.orchestra.run.smithi117.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-12T01:55:19.559 INFO:teuthology.orchestra.run.smithi189.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 546 kB/s | 32 kB 00:00 2024-09-12T01:55:19.567 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-12T01:55:19.605 INFO:teuthology.orchestra.run.smithi117.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-09-12T01:55:19.626 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T01:55:19.643 INFO:teuthology.orchestra.run.smithi189.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-12T01:55:19.668 INFO:teuthology.orchestra.run.smithi189.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.3 MB/s | 146 kB 00:00 2024-09-12T01:55:19.672 INFO:teuthology.orchestra.run.smithi117.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 806 kB/s | 54 kB 00:00 2024-09-12T01:55:19.684 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T01:55:19.706 INFO:teuthology.orchestra.run.smithi117.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-09-12T01:55:19.760 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 918 kB/s | 253 kB 00:00 2024-09-12T01:55:19.773 INFO:teuthology.orchestra.run.smithi117.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-12T01:55:19.801 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-12T01:55:19.827 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 878 kB/s | 125 kB 00:00 2024-09-12T01:55:19.840 INFO:teuthology.orchestra.run.smithi117.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 663 kB/s | 44 kB 00:00 2024-09-12T01:55:19.860 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T01:55:19.965 INFO:teuthology.orchestra.run.smithi117.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.0 MB/s | 5.1 MB 00:00 2024-09-12T01:55:19.985 INFO:teuthology.orchestra.run.smithi189.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 10 MB/s | 3.6 MB 00:00 2024-09-12T01:55:19.985 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-09-12T01:55:19.990 INFO:teuthology.orchestra.run.smithi117.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-12T01:55:20.019 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 675 kB/s | 107 kB 00:00 2024-09-12T01:55:20.044 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-12T01:55:20.049 INFO:teuthology.orchestra.run.smithi117.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 432 kB/s | 36 kB 00:00 2024-09-12T01:55:20.061 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 287 kB/s | 22 kB 00:00 2024-09-12T01:55:20.111 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-12T01:55:20.137 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-12T01:55:20.179 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-12T01:55:20.207 INFO:teuthology.orchestra.run.smithi117.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-12T01:55:20.229 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-12T01:55:20.246 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-12T01:55:20.271 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-12T01:55:20.274 INFO:teuthology.orchestra.run.smithi117.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 868 kB/s | 58 kB 00:00 2024-09-12T01:55:20.305 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-12T01:55:20.308 INFO:teuthology.orchestra.run.smithi117.stdout:(99/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 149 kB/s | 47 kB 00:00 2024-09-12T01:55:20.330 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-12T01:55:20.361 INFO:teuthology.orchestra.run.smithi117.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-12T01:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-12T01:55:20.383 INFO:teuthology.orchestra.run.smithi117.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 64 kB 00:00 2024-09-12T01:55:20.406 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 243 kB/s | 24 kB 00:00 2024-09-12T01:55:20.440 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-12T01:55:20.442 INFO:teuthology.orchestra.run.smithi117.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-09-12T01:55:20.460 INFO:teuthology.orchestra.run.smithi189.stdout:(32/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 20 MB/s | 49 MB 00:02 2024-09-12T01:55:20.473 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-12T01:55:20.476 INFO:teuthology.orchestra.run.smithi117.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-12T01:55:20.485 INFO:teuthology.orchestra.run.smithi189.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 498 kB/s | 249 kB 00:00 2024-09-12T01:55:20.498 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-12T01:55:20.511 INFO:teuthology.orchestra.run.smithi189.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 986 kB/s | 49 kB 00:00 2024-09-12T01:55:20.523 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-12T01:55:20.543 INFO:teuthology.orchestra.run.smithi117.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-12T01:55:20.560 INFO:teuthology.orchestra.run.smithi189.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 220 kB/s | 16 kB 00:00 2024-09-12T01:55:20.577 INFO:teuthology.orchestra.run.smithi117.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T01:55:20.594 INFO:teuthology.orchestra.run.smithi189.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.4 MB/s | 285 kB 00:00 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-12T01:55:20.674 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-12T01:55:20.686 INFO:teuthology.orchestra.run.smithi189.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 7.3 MB/s | 7.4 MB 00:01 2024-09-12T01:55:20.712 INFO:teuthology.orchestra.run.smithi189.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 156 kB/s | 18 kB 00:00 2024-09-12T01:55:20.735 INFO:teuthology.orchestra.run.smithi117.stdout:(106/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-12T01:55:20.741 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T01:55:20.745 INFO:teuthology.orchestra.run.smithi189.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-12T01:55:20.760 INFO:teuthology.orchestra.run.smithi117.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 106 kB/s | 19 kB 00:00 2024-09-12T01:55:20.769 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-12T01:55:20.792 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-12T01:55:20.794 INFO:teuthology.orchestra.run.smithi117.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:55:20.819 INFO:teuthology.orchestra.run.smithi117.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-12T01:55:20.837 INFO:teuthology.orchestra.run.smithi189.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-12T01:55:20.844 INFO:teuthology.orchestra.run.smithi117.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-12T01:55:20.859 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T01:55:20.869 INFO:teuthology.orchestra.run.smithi117.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T01:55:20.879 INFO:teuthology.orchestra.run.smithi189.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-12T01:55:20.892 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-12T01:55:20.920 INFO:teuthology.orchestra.run.smithi117.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 19 MB/s | 839 kB 00:00 2024-09-12T01:55:20.921 INFO:teuthology.orchestra.run.smithi189.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T01:55:20.953 INFO:teuthology.orchestra.run.smithi117.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-12T01:55:20.954 INFO:teuthology.orchestra.run.smithi189.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-12T01:55:20.970 INFO:teuthology.orchestra.run.smithi117.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T01:55:20.980 INFO:teuthology.orchestra.run.smithi189.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T01:55:20.984 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-12T01:55:20.996 INFO:teuthology.orchestra.run.smithi117.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-12T01:55:21.005 INFO:teuthology.orchestra.run.smithi189.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T01:55:21.009 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-12T01:55:21.021 INFO:teuthology.orchestra.run.smithi117.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 637 kB/s | 32 kB 00:00 2024-09-12T01:55:21.030 INFO:teuthology.orchestra.run.smithi189.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T01:55:21.046 INFO:teuthology.orchestra.run.smithi117.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T01:55:21.055 INFO:teuthology.orchestra.run.smithi189.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T01:55:21.080 INFO:teuthology.orchestra.run.smithi117.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T01:55:21.089 INFO:teuthology.orchestra.run.smithi189.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-12T01:55:21.101 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-09-12T01:55:21.105 INFO:teuthology.orchestra.run.smithi117.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T01:55:21.127 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-12T01:55:21.139 INFO:teuthology.orchestra.run.smithi117.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:55:21.152 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-12T01:55:21.164 INFO:teuthology.orchestra.run.smithi117.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T01:55:21.177 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-12T01:55:21.189 INFO:teuthology.orchestra.run.smithi117.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:55:21.215 INFO:teuthology.orchestra.run.smithi117.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T01:55:21.219 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-12T01:55:21.231 INFO:teuthology.orchestra.run.smithi189.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-09-12T01:55:21.240 INFO:teuthology.orchestra.run.smithi117.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-12T01:55:21.244 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-12T01:55:21.265 INFO:teuthology.orchestra.run.smithi117.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-12T01:55:21.270 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 376 kB/s | 35 kB 00:00 2024-09-12T01:55:21.281 INFO:teuthology.orchestra.run.smithi189.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-12T01:55:21.290 INFO:teuthology.orchestra.run.smithi117.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-12T01:55:21.311 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-12T01:55:21.316 INFO:teuthology.orchestra.run.smithi117.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-12T01:55:21.337 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-12T01:55:21.348 INFO:teuthology.orchestra.run.smithi189.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-12T01:55:21.391 INFO:teuthology.orchestra.run.smithi117.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-12T01:55:21.398 INFO:teuthology.orchestra.run.smithi189.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-12T01:55:21.403 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-12T01:55:21.416 INFO:teuthology.orchestra.run.smithi117.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:55:21.424 INFO:teuthology.orchestra.run.smithi189.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 943 kB 00:00 2024-09-12T01:55:21.429 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 459 kB/s | 42 kB 00:00 2024-09-12T01:55:21.442 INFO:teuthology.orchestra.run.smithi117.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:55:21.454 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 542 kB/s | 77 kB 00:00 2024-09-12T01:55:21.466 INFO:teuthology.orchestra.run.smithi189.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-12T01:55:21.467 INFO:teuthology.orchestra.run.smithi117.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:55:21.483 INFO:teuthology.orchestra.run.smithi189.stdout:(55/156): flexiblas-3.0.4-8.el9.x86_64.rpm 243 kB/s | 33 kB 00:00 2024-09-12T01:55:21.496 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-12T01:55:21.500 INFO:teuthology.orchestra.run.smithi117.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-12T01:55:21.516 INFO:teuthology.orchestra.run.smithi189.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T01:55:21.526 INFO:teuthology.orchestra.run.smithi117.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T01:55:21.538 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-12T01:55:21.551 INFO:teuthology.orchestra.run.smithi117.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T01:55:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-12T01:55:21.567 INFO:teuthology.orchestra.run.smithi189.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-12T01:55:21.583 INFO:teuthology.orchestra.run.smithi189.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-09-12T01:55:21.588 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-12T01:55:21.602 INFO:teuthology.orchestra.run.smithi117.stdout:(135/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-12T01:55:21.614 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-12T01:55:21.627 INFO:teuthology.orchestra.run.smithi117.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 895 kB/s | 90 kB 00:00 2024-09-12T01:55:21.652 INFO:teuthology.orchestra.run.smithi117.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-09-12T01:55:21.664 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-12T01:55:21.677 INFO:teuthology.orchestra.run.smithi117.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-12T01:55:21.698 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 527 kB/s | 44 kB 00:00 2024-09-12T01:55:21.702 INFO:teuthology.orchestra.run.smithi117.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T01:55:21.728 INFO:teuthology.orchestra.run.smithi117.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-12T01:55:21.740 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-12T01:55:21.753 INFO:teuthology.orchestra.run.smithi117.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T01:55:21.767 INFO:teuthology.orchestra.run.smithi189.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-12T01:55:21.778 INFO:teuthology.orchestra.run.smithi117.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-12T01:55:21.782 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 430 kB/s | 36 kB 00:00 2024-09-12T01:55:21.793 INFO:teuthology.orchestra.run.smithi189.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-12T01:55:21.795 INFO:teuthology.orchestra.run.smithi117.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 5.4 MB/s | 90 kB 00:00 2024-09-12T01:55:21.807 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 713 kB/s | 47 kB 00:00 2024-09-12T01:55:21.809 INFO:teuthology.orchestra.run.smithi189.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 585 kB/s | 24 kB 00:00 2024-09-12T01:55:21.820 INFO:teuthology.orchestra.run.smithi117.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-12T01:55:21.835 INFO:teuthology.orchestra.run.smithi189.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T01:55:21.846 INFO:teuthology.orchestra.run.smithi117.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-09-12T01:55:21.871 INFO:teuthology.orchestra.run.smithi117.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:55:21.896 INFO:teuthology.orchestra.run.smithi117.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-12T01:55:21.918 INFO:teuthology.orchestra.run.smithi189.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-12T01:55:21.944 INFO:teuthology.orchestra.run.smithi189.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-12T01:55:21.947 INFO:teuthology.orchestra.run.smithi117.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T01:55:21.960 INFO:teuthology.orchestra.run.smithi189.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 922 kB/s | 38 kB 00:00 2024-09-12T01:55:21.974 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-12T01:55:21.999 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2024-09-12T01:55:22.033 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-12T01:55:22.058 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-12T01:55:22.084 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 760 kB/s | 64 kB 00:00 2024-09-12T01:55:22.097 INFO:teuthology.orchestra.run.smithi117.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-09-12T01:55:22.125 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 487 kB/s | 45 kB 00:00 2024-09-12T01:55:22.156 INFO:teuthology.orchestra.run.smithi117.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T01:55:22.161 INFO:teuthology.orchestra.run.smithi189.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-09-12T01:55:22.175 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:55:22.201 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-12T01:55:22.234 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 5.1 MB/s | 309 kB 00:00 2024-09-12T01:55:22.239 INFO:teuthology.orchestra.run.smithi117.stdout:(151/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-12T01:55:22.260 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-12T01:55:22.264 INFO:teuthology.orchestra.run.smithi117.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-12T01:55:22.285 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:55:22.310 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-12T01:55:22.340 INFO:teuthology.orchestra.run.smithi117.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.4 MB/s | 249 kB 00:00 2024-09-12T01:55:22.344 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2024-09-12T01:55:22.377 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-12T01:55:22.403 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-12T01:55:22.406 INFO:teuthology.orchestra.run.smithi117.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-12T01:55:22.461 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-12T01:55:22.487 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-12T01:55:22.504 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-12T01:55:22.521 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 966 kB/s | 32 kB 00:00 2024-09-12T01:55:22.523 INFO:teuthology.orchestra.run.smithi117.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 4.2 MB/s | 1.8 MB 00:00 2024-09-12T01:55:22.537 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 421 kB/s | 14 kB 00:00 2024-09-12T01:55:22.544 INFO:teuthology.orchestra.run.smithi189.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-09-12T01:55:22.571 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T01:55:22.596 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T01:55:22.615 INFO:teuthology.orchestra.run.smithi117.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.7 MB/s | 2.4 MB 00:00 2024-09-12T01:55:22.623 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:55:22.623 INFO:teuthology.orchestra.run.smithi117.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-12T01:55:22.630 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:55:22.655 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T01:55:22.714 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-12T01:55:22.739 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-12T01:55:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T01:55:22.786 INFO:teuthology.orchestra.run.smithi189.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.7 MB/s | 910 kB 00:00 2024-09-12T01:55:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T01:55:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T01:55:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T01:55:22.853 INFO:teuthology.orchestra.run.smithi189.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T01:55:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T01:55:22.891 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:55:22.925 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T01:55:22.950 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:55:22.992 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-12T01:55:23.021 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-12T01:55:23.043 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-12T01:55:23.059 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.4 MB/s | 90 kB 00:00 2024-09-12T01:55:23.085 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 682 kB/s | 28 kB 00:00 2024-09-12T01:55:23.126 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-09-12T01:55:23.152 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-09-12T01:55:23.177 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T01:55:23.203 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T01:55:23.228 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-12T01:55:23.237 INFO:teuthology.orchestra.run.smithi189.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-12T01:55:23.253 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-12T01:55:23.278 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T01:55:23.295 INFO:teuthology.orchestra.run.smithi189.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-12T01:55:23.303 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T01:55:23.329 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T01:55:23.345 INFO:teuthology.orchestra.run.smithi189.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-12T01:55:23.354 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:55:23.379 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T01:55:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T01:55:23.521 INFO:teuthology.orchestra.run.smithi189.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-09-12T01:55:23.571 INFO:teuthology.orchestra.run.smithi189.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-12T01:55:23.671 INFO:teuthology.orchestra.run.smithi189.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T01:55:23.713 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 9.5 MB/s | 3.4 MB 00:00 2024-09-12T01:55:23.763 INFO:teuthology.orchestra.run.smithi189.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-12T01:55:23.771 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 8.1 MB/s | 3.2 MB 00:00 2024-09-12T01:55:23.813 INFO:teuthology.orchestra.run.smithi189.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-12T01:55:23.814 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-12T01:55:23.821 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 6.0 MB/s | 2.3 MB 00:00 2024-09-12T01:55:23.880 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-12T01:55:23.928 INFO:teuthology.orchestra.run.smithi189.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 168 kB/s | 19 kB 00:00 2024-09-12T01:55:23.964 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 212 kB/s | 41 kB 00:00 2024-09-12T01:55:23.965 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-12T01:55:23.965 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-12T01:55:24.006 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 6.2 MB/s | 1.8 MB 00:00 2024-09-12T01:55:24.040 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-12T01:55:24.056 INFO:teuthology.orchestra.run.smithi189.stdout:(79/156): postgresql-server-13.16-1.el9.x86_64. 4.8 MB/s | 5.8 MB 00:01 2024-09-12T01:55:24.081 INFO:teuthology.orchestra.run.smithi189.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-12T01:55:24.115 INFO:teuthology.orchestra.run.smithi189.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-09-12T01:55:24.173 INFO:teuthology.orchestra.run.smithi189.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-12T01:55:24.232 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-09-12T01:55:24.232 INFO:teuthology.orchestra.run.smithi189.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T01:55:24.238 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:55:24.238 INFO:teuthology.orchestra.run.smithi100.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-12T01:55:24.291 INFO:teuthology.orchestra.run.smithi189.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T01:55:24.349 INFO:teuthology.orchestra.run.smithi189.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-12T01:55:24.425 INFO:teuthology.orchestra.run.smithi189.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.5 MB/s | 6.0 MB 00:01 2024-09-12T01:55:24.453 INFO:teuthology.orchestra.run.smithi189.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-12T01:55:24.475 INFO:teuthology.orchestra.run.smithi189.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T01:55:24.509 INFO:teuthology.orchestra.run.smithi189.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T01:55:24.526 INFO:teuthology.orchestra.run.smithi189.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:55:24.551 INFO:teuthology.orchestra.run.smithi189.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-12T01:55:24.593 INFO:teuthology.orchestra.run.smithi189.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-12T01:55:24.643 INFO:teuthology.orchestra.run.smithi189.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-09-12T01:55:24.702 INFO:teuthology.orchestra.run.smithi189.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T01:55:24.752 INFO:teuthology.orchestra.run.smithi189.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-09-12T01:55:24.794 INFO:teuthology.orchestra.run.smithi189.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T01:55:24.853 INFO:teuthology.orchestra.run.smithi189.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T01:55:24.944 INFO:teuthology.orchestra.run.smithi189.stdout:(98/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-09-12T01:55:24.961 INFO:teuthology.orchestra.run.smithi189.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-12T01:55:24.995 INFO:teuthology.orchestra.run.smithi189.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T01:55:25.012 INFO:teuthology.orchestra.run.smithi189.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:55:25.037 INFO:teuthology.orchestra.run.smithi189.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-12T01:55:25.096 INFO:teuthology.orchestra.run.smithi189.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-09-12T01:55:25.146 INFO:teuthology.orchestra.run.smithi189.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:55:25.180 INFO:teuthology.orchestra.run.smithi189.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T01:55:25.196 INFO:teuthology.orchestra.run.smithi189.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-12T01:55:25.280 INFO:teuthology.orchestra.run.smithi189.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-12T01:55:25.355 INFO:teuthology.orchestra.run.smithi189.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-12T01:55:25.381 INFO:teuthology.orchestra.run.smithi189.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-12T01:55:25.420 INFO:teuthology.orchestra.run.smithi189.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 186 kB/s | 26 kB 00:00 2024-09-12T01:55:25.448 INFO:teuthology.orchestra.run.smithi189.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-12T01:55:25.460 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-12T01:55:25.477 INFO:teuthology.orchestra.run.smithi189.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.8 MB/s | 151 kB 00:00 2024-09-12T01:55:25.515 INFO:teuthology.orchestra.run.smithi189.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T01:55:25.541 INFO:teuthology.orchestra.run.smithi189.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T01:55:25.566 INFO:teuthology.orchestra.run.smithi189.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 863 kB/s | 43 kB 00:00 2024-09-12T01:55:25.591 INFO:teuthology.orchestra.run.smithi189.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-12T01:55:25.610 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-12T01:55:25.610 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-12T01:55:25.616 INFO:teuthology.orchestra.run.smithi189.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-12T01:55:25.642 INFO:teuthology.orchestra.run.smithi189.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T01:55:25.667 INFO:teuthology.orchestra.run.smithi189.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T01:55:25.692 INFO:teuthology.orchestra.run.smithi189.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T01:55:25.718 INFO:teuthology.orchestra.run.smithi189.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T01:55:25.751 INFO:teuthology.orchestra.run.smithi189.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T01:55:25.759 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-12T01:55:25.759 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-12T01:55:25.777 INFO:teuthology.orchestra.run.smithi189.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T01:55:25.794 INFO:teuthology.orchestra.run.smithi189.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T01:55:25.811 INFO:teuthology.orchestra.run.smithi189.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T01:55:25.828 INFO:teuthology.orchestra.run.smithi189.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T01:55:25.844 INFO:teuthology.orchestra.run.smithi189.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T01:55:25.912 INFO:teuthology.orchestra.run.smithi189.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-12T01:55:25.937 INFO:teuthology.orchestra.run.smithi189.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi189.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi189.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-12T01:55:26.021 INFO:teuthology.orchestra.run.smithi189.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T01:55:26.046 INFO:teuthology.orchestra.run.smithi189.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-12T01:55:26.071 INFO:teuthology.orchestra.run.smithi189.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-12T01:55:26.105 INFO:teuthology.orchestra.run.smithi189.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-12T01:55:26.130 INFO:teuthology.orchestra.run.smithi189.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-12T01:55:26.156 INFO:teuthology.orchestra.run.smithi189.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T01:55:26.181 INFO:teuthology.orchestra.run.smithi189.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:55:26.206 INFO:teuthology.orchestra.run.smithi189.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T01:55:26.231 INFO:teuthology.orchestra.run.smithi189.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-12T01:55:26.257 INFO:teuthology.orchestra.run.smithi189.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T01:55:26.282 INFO:teuthology.orchestra.run.smithi189.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T01:55:26.316 INFO:teuthology.orchestra.run.smithi189.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T01:55:26.341 INFO:teuthology.orchestra.run.smithi189.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2024-09-12T01:55:26.375 INFO:teuthology.orchestra.run.smithi189.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-12T01:55:26.400 INFO:teuthology.orchestra.run.smithi189.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-12T01:55:26.450 INFO:teuthology.orchestra.run.smithi189.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T01:55:26.692 INFO:teuthology.orchestra.run.smithi189.stdout:(148/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T01:55:26.742 INFO:teuthology.orchestra.run.smithi189.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-12T01:55:26.876 INFO:teuthology.orchestra.run.smithi189.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-12T01:55:26.918 INFO:teuthology.orchestra.run.smithi189.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-09-12T01:55:26.943 INFO:teuthology.orchestra.run.smithi189.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 611 kB/s | 41 kB 00:00 2024-09-12T01:55:26.969 INFO:teuthology.orchestra.run.smithi189.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-12T01:55:27.011 INFO:teuthology.orchestra.run.smithi189.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-12T01:55:27.069 INFO:teuthology.orchestra.run.smithi189.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-12T01:55:27.553 INFO:teuthology.orchestra.run.smithi189.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.4 MB/s | 16 MB 00:03 2024-09-12T01:55:27.558 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:55:27.558 INFO:teuthology.orchestra.run.smithi189.stdout:Total 19 MB/s | 226 MB 00:12 2024-09-12T01:55:27.812 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-12T01:55:27.813 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-12T01:55:28.803 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-12T01:55:28.955 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-12T01:55:28.955 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-12T01:55:30.765 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-12T01:55:30.766 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-12T01:55:32.076 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-12T01:55:32.168 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:55:32.206 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:55:32.260 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:55:32.294 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:55:32.319 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:55:32.370 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:55:32.709 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:55:32.812 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:55:32.934 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:55:32.971 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:55:33.046 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:55:33.076 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:55:33.224 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:55:33.273 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:55:33.301 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:55:33.396 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:55:33.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:55:33.511 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:55:33.534 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:55:33.720 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:55:33.859 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:55:33.984 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:55:34.087 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:34.122 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-12T01:55:34.153 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:34.294 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:55:34.332 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:55:34.368 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:34.391 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:55:34.428 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:55:34.453 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:55:34.492 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:55:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:55:34.616 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:55:34.650 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:55:34.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:55:34.767 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:55:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:55:34.843 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:55:34.853 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:55:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:55:34.904 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:55:34.964 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:55:34.971 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:55:35.026 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:55:35.057 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:55:35.086 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:55:35.098 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:55:35.115 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:55:35.168 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:55:35.198 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:55:35.207 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:55:35.237 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:55:35.241 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:55:35.270 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:55:35.338 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:55:35.393 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:55:35.408 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:55:35.466 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:55:35.467 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:55:35.494 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:55:35.598 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:55:35.598 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:55:35.620 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:55:35.653 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:55:35.689 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:55:35.713 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:55:35.733 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:55:36.104 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:55:36.169 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:55:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:55:36.341 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:36.360 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:55:36.401 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:55:36.413 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:36.556 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:55:36.613 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:55:36.631 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:36.666 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:55:36.731 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:55:36.742 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:55:36.763 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:55:36.799 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:55:36.838 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:55:36.846 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:55:36.869 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:55:36.882 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:55:36.902 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:55:36.925 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:55:36.967 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:55:36.969 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:55:37.012 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:55:37.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:55:37.100 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:55:37.101 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:55:37.102 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-12T01:55:37.129 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:55:37.153 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:55:37.157 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:55:37.195 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:55:37.226 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:55:37.239 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:55:37.279 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:55:37.310 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:55:37.759 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:55:37.943 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:55:37.945 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:55:37.949 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:55:38.752 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:55:38.774 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:55:38.801 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:55:38.861 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:55:38.928 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:55:38.983 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:55:38.992 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:55:39.057 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:55:39.088 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:55:39.124 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:55:39.131 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:55:39.171 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:55:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:55:39.250 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:55:39.267 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:55:39.300 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:55:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:55:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:55:39.366 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:39.386 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:55:39.437 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:55:39.439 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:55:39.527 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:55:39.542 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:55:39.586 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:55:39.630 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:55:39.661 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:55:39.666 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:55:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:55:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:55:39.775 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:55:39.792 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:55:39.866 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:55:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:55:39.903 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:55:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:55:39.935 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:55:39.938 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:55:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:55:40.015 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:55:40.069 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:55:40.093 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:55:40.099 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:55:40.144 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:55:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:55:40.198 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:55:40.212 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:55:40.291 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:55:40.328 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:55:40.351 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:55:40.366 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:55:40.382 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:55:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:55:40.425 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:55:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:55:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:55:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:55:40.503 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:55:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:55:40.536 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:55:40.555 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:55:40.580 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:55:40.583 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:55:40.608 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:55:40.616 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:55:40.625 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:55:40.660 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:55:40.680 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:55:40.732 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:55:40.733 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:55:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:55:40.782 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:55:40.813 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:55:40.815 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:55:40.915 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:55:40.952 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:55:40.964 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:55:41.009 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:55:41.553 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:55:41.638 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:55:41.674 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:55:41.687 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:55:41.717 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:55:41.736 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:55:41.755 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:55:41.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:55:41.797 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:55:41.871 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:55:41.925 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:55:41.929 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:55:41.961 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:55:41.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:55:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:55:42.033 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:55:42.051 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:55:42.084 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:55:42.088 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:55:42.097 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:55:42.161 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:55:42.192 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:55:42.228 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:55:42.275 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:55:42.283 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:55:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:55:42.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:55:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:55:42.392 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:55:42.393 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:55:42.405 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:55:42.439 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:55:42.521 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:55:42.543 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:55:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:55:42.631 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:55:42.735 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:55:42.773 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:55:42.854 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:55:43.038 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:55:43.042 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:55:43.068 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:55:43.071 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:55:43.108 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:55:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:55:43.171 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:55:43.179 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:55:43.202 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:55:43.283 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:55:43.336 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:55:43.381 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:55:43.424 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:55:43.463 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:55:43.494 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:55:43.524 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:55:43.559 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:55:43.592 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:55:43.634 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:55:43.668 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:55:43.756 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:55:43.807 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:55:43.866 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:55:43.975 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:55:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:55:44.411 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:55:44.493 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:55:44.521 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:55:44.554 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:55:44.753 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:55:44.803 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:55:44.836 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:55:44.863 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:55:44.909 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:55:44.945 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:55:45.000 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:55:45.009 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:55:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:55:45.054 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:55:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:55:45.142 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:55:45.183 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:55:45.369 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:55:45.397 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:55:45.475 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:55:45.508 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:45.540 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:45.544 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:55:45.587 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:55:45.658 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:55:45.688 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:55:46.087 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:55:46.132 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:55:46.221 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:55:46.221 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:55:46.222 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:55:46.222 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:55:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:55:46.261 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:55:47.493 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:55:47.583 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:55:47.619 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:55:47.661 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:55:47.972 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:55:48.004 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:48.015 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:55:48.052 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:48.105 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:55:48.136 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:55:48.189 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:55:48.605 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:48.647 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:55:48.668 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:55:48.701 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:55:48.742 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:55:48.742 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:55:48.742 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:55:48.742 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:55:48.773 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:55:48.781 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:55:51.134 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:51.166 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:51.720 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:55:51.855 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:55:51.855 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:55:51.856 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:55:51.856 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:55:51.887 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:55:57.960 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-12T01:55:57.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:55:58.139 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:55:58.156 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:55:58.156 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:55:58.156 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:55:58.156 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:55:59.625 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:55:59.651 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:55:59.652 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:55:59.652 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:55:59.652 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:55:59.652 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:55:59.652 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:55:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:55:59.907 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:55:59.908 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:55:59.908 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:55:59.908 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:55:59.908 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:55:59.908 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:00.343 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:56:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:56:00.367 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:00.367 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:56:00.367 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:56:00.367 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:56:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:00.465 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:56:00.512 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:56:00.568 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:56:00.597 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:56:00.597 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-12T01:56:00.598 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-12T01:56:00.598 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-12T01:56:00.598 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-12T01:56:00.598 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-12T01:56:00.598 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-12T01:56:00.598 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-12T01:56:00.598 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:00.752 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:56:00.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:56:00.787 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:56:00.787 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:00.787 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:56:00.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:00.802 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:56:00.870 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:56:00.969 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:56:01.115 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:56:01.160 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:56:01.192 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:56:01.220 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:56:01.670 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:56:01.702 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:56:01.733 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:56:01.795 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:56:01.825 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:56:02.298 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:56:02.325 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:56:02.325 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:02.325 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:56:02.326 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:56:02.326 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:56:02.326 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:02.549 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:56:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:56:02.572 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:02.572 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:56:02.573 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:56:02.573 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:56:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:02.871 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:56:02.901 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:56:03.016 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:56:03.040 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:56:03.040 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:03.040 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:56:03.040 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:56:03.040 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:56:03.040 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:03.172 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:56:03.229 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:56:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:56:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:56:03.517 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-12T01:56:03.521 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-12T01:56:03.522 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:03.595 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:56:03.683 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:56:03.714 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:56:03.731 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:56:03.731 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:03.731 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:56:03.731 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:03.823 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:56:03.868 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:56:03.873 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:56:03.894 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:56:03.899 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:56:03.935 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:56:03.996 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:56:04.156 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:56:04.196 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:56:04.219 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:56:04.220 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:04.220 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:56:04.220 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:56:04.220 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:56:04.221 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:04.263 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:56:04.275 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:56:04.374 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:56:04.386 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:56:04.418 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:56:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:56:04.449 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:56:04.511 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:56:04.540 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:56:05.208 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:56:05.235 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:56:05.235 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:05.235 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:56:05.235 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:56:05.235 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:56:05.235 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:05.348 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:56:05.374 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:56:05.397 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:56:05.397 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:05.397 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:56:05.397 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:56:05.397 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:56:05.398 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:05.441 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:56:05.459 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:56:05.463 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:56:05.463 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:05.464 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:56:05.464 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:05.483 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:56:05.483 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:05.484 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:56:05.484 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:56:05.484 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:56:05.484 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:05.508 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:56:05.531 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:56:05.531 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:05.531 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:56:05.531 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:56:05.531 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:56:05.532 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:56:05.626 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:56:05.842 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:56:05.865 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:56:05.865 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:05.865 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:56:05.865 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:56:05.866 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:56:05.866 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:05.926 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:56:05.951 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:56:05.951 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:05.951 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:56:05.951 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:56:05.951 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:56:05.951 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:06.065 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:56:06.122 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:56:06.177 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:56:06.364 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:56:06.418 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:56:06.505 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:56:06.591 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:56:06.601 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:56:06.626 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:56:06.729 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:56:06.741 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:56:06.794 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:56:06.826 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:56:06.861 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:56:06.888 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:56:06.920 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:56:06.943 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:56:06.944 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:06.944 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:56:06.944 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:56:06.944 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:56:06.944 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:06.996 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:56:07.007 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:56:07.105 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:56:07.154 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:56:07.304 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:56:07.335 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:56:07.366 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:56:07.454 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:56:07.483 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:56:08.075 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:56:08.106 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:56:08.130 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:56:08.130 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:08.130 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:56:08.130 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:56:08.130 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:56:08.130 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:08.173 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:56:08.196 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:56:08.197 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:08.197 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:56:08.197 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:08.266 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:56:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:56:08.289 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:08.289 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:56:08.289 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:56:08.289 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:56:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:08.535 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:56:08.576 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:56:08.591 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:56:08.615 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:56:08.615 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:08.615 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:56:08.615 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:56:08.615 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:56:08.615 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:09.550 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:56:09.589 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:56:09.689 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:56:09.855 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:56:09.887 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:56:09.912 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:56:09.912 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:09.912 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:56:09.912 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:56:09.912 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:56:09.912 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:09.962 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:56:09.975 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:56:10.074 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:56:10.119 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:56:10.412 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:56:10.453 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:56:10.494 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:56:10.526 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:56:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:56:10.733 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:56:10.768 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:56:10.798 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:56:10.832 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:56:10.865 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:56:11.045 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:56:11.082 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:56:11.106 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:56:11.106 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:11.106 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:56:11.106 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:56:11.106 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:56:11.106 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:11.149 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:56:11.172 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:56:11.173 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:11.173 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:56:11.173 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:11.224 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:56:11.248 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:56:11.248 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:11.248 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:56:11.248 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:56:11.249 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:56:11.249 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:11.484 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:11.521 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:11.541 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:11.550 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:56:11.574 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:56:11.574 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:56:11.575 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:56:11.575 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:56:11.575 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:56:11.575 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:12.356 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:56:12.459 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:56:12.499 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:56:12.583 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:56:12.620 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:56:12.662 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:56:12.689 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:56:12.689 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:56:12.756 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:56:12.756 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:56:12.824 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:56:12.848 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:56:12.853 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:12.853 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:13.042 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:13.042 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:56:13.126 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:56:13.195 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:56:13.198 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:56:13.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:56:13.310 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:56:13.337 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:56:13.536 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:56:13.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:56:13.614 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:56:13.644 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:56:13.690 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:56:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:56:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:56:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:56:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:56:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:56:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:56:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:56:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:56:15.564 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:56:15.565 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:56:15.632 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:56:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:56:15.663 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:15.663 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:56:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:56:15.992 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:16.145 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:56:16.186 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:56:16.227 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:56:16.259 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:56:16.287 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:56:16.478 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:56:16.525 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:56:16.555 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:56:16.585 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:56:16.648 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:56:17.250 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:17.287 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:17.308 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:56:18.173 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:56:18.274 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:56:18.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:56:18.398 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:56:18.444 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:56:18.469 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:56:18.496 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:56:18.496 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:56:18.579 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:56:18.579 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:56:18.672 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:56:18.685 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:56:18.686 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:56:18.687 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:56:18.698 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:56:18.698 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:56:18.698 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:56:18.698 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:56:18.698 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:56:18.698 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:56:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:56:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:56:18.701 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:56:18.702 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:56:18.703 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:56:18.704 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:56:18.705 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:56:18.706 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:56:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:56:18.708 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:56:18.709 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:56:18.709 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:18.709 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:18.882 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:56:18.882 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:56:18.974 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:56:19.037 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:21.279 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.281 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:56:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:56:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:56:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:56:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:56:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:56:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:56:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:56:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:56:21.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:56:21.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:56:21.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:56:21.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:56:21.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:56:21.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:56:21.292 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.293 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:56:21.294 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:56:21.295 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:56:21.296 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:56:21.296 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:56:21.296 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:56:21.296 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:56:21.296 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:56:21.297 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:56:21.297 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-12T01:56:21.667 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:21.667 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:56:21.667 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:56:21.667 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:56:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:56:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:56:21.680 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:56:21.681 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:56:21.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:56:21.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:56:21.684 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:56:21.685 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:56:21.686 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:56:21.687 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:56:21.688 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:56:21.689 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:56:21.690 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:56:21.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:56:21.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:56:21.705 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:56:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:56:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:56:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:56:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:56:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:56:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:56:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:56:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:56:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:56:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:56:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:56:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:56:24.276 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-12T01:56:24.707 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:56:24.711 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:56:24.712 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:56:24.713 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:56:24.727 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:56:24.728 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:56:24.729 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:56:24.730 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:56:24.731 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:56:24.732 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:56:24.733 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:56:24.734 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:56:24.735 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:56:24.736 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:56:24.737 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:56:24.738 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:56:24.739 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:56:27.413 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:56:27.413 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:56:27.414 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.415 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.416 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:56:27.417 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:56:27.418 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:56:27.419 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.420 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:56:27.421 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:56:27.422 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:56:27.423 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:56:27.424 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:56:27.425 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:56:27.426 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-12T01:56:27.837 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:27.838 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:56:27.989 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:56:28.015 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:56:28.016 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:56:28.016 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:56:28.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:56:28.163 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:56:28.190 INFO:teuthology.orchestra.run.smithi117.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:56:28.190 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:56:28.190 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:56:28.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:56:28.336 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:56:28.360 INFO:teuthology.orchestra.run.smithi189.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:56:28.360 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:56:28.361 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:56:28.362 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:56:28.363 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:56:28.363 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:56:28.395 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:56:28.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:56:28.428 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:56:28.428 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:56:28.457 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:56:28.457 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:56:28.457 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:56:28.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:56:28.558 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:56:28.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:56:28.588 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:56:28.656 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:56:28.656 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:56:28.682 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:56:28.747 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:56:28.748 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:56:28.748 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:56:28.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:56:28.846 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:56:28.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:56:28.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:56:28.941 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:56:28.941 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:56:28.967 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:56:29.033 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:56:29.033 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:56:29.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:56:29.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:56:29.132 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:56:29.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:56:29.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:56:29.226 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:56:29.226 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:56:29.251 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:56:29.317 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T01:56:29.428 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-12T01:56:29.428 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:56:29.429 INFO:tasks.cephadm:Cluster fsid is 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:56:29.429 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T01:56:29.429 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.100', 'mon.b': '172.21.15.117', 'mon.c': '172.21.15.189'} 2024-09-12T01:56:29.429 INFO:tasks.cephadm:First mon is mon.a on smithi100 2024-09-12T01:56:29.429 INFO:tasks.cephadm:First mgr is x 2024-09-12T01:56:29.430 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T01:56:29.430 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-09-12T01:56:29.460 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname $(hostname -s) 2024-09-12T01:56:29.487 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-12T01:56:29.513 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T01:56:29.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:56:29.664 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T01:56:29.805 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:56:29.806 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:56:29.807 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:56:29.807 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:30.184 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:56 /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:30.185 DEBUG:teuthology.orchestra.run.smithi117:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:30.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:56 /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:30.586 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:30.984 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:56 /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:30.985 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:31.005 DEBUG:teuthology.orchestra.run.smithi117:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:31.025 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:56:31.062 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T01:56:31.062 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:56:31.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:56:31.068 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:56:32.598 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:56:32.608 INFO:teuthology.orchestra.run.smithi117.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:56:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:57:02.073 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T01:57:02.073 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:57:02.073 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:57:02.073 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-09-12T01:57:02.073 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:57:02.073 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T01:57:02.073 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T01:57:27.208 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T01:57:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:57:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:57:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-12T01:57:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:57:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-12T01:57:27.209 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T01:57:27.871 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T01:57:27.871 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:57:27.871 INFO:teuthology.orchestra.run.smithi117.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:57:27.871 INFO:teuthology.orchestra.run.smithi117.stdout: "repo_digests": [ 2024-09-12T01:57:27.871 INFO:teuthology.orchestra.run.smithi117.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:57:27.872 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-09-12T01:57:27.872 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T01:57:27.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-09-12T01:57:27.930 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph 2024-09-12T01:57:27.957 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-12T01:57:27.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-09-12T01:57:28.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /etc/ceph 2024-09-12T01:57:28.045 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-12T01:57:28.074 INFO:tasks.cephadm:Writing seed config... 2024-09-12T01:57:28.075 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T01:57:28.075 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T01:57:28.075 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T01:57:28.075 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T01:57:28.075 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T01:57:28.075 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T01:57:28.075 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T01:57:28.076 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-12T01:57:28.077 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T01:57:28.078 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T01:57:28.079 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T01:57:28.079 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T01:57:28.079 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:57:28.080 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T01:57:28.098 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3a2902f2-70aa-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T01:57:28.099 DEBUG:teuthology.orchestra.run.smithi100:mon.a> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T01:57:28.142 DEBUG:teuthology.orchestra.run.smithi100:mgr.x> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T01:57:28.190 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T01:57:28.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.100 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:57:28.401 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:57:28.402 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '3a2902f2-70aa-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.100', '--skip-admin-label'] 2024-09-12T01:57:28.402 INFO:teuthology.orchestra.run.smithi100.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T01:57:28.402 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying podman|docker is present... 2024-09-12T01:57:28.426 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:57:28.426 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying lvm2 is present... 2024-09-12T01:57:28.426 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying time synchronization is in place... 2024-09-12T01:57:28.434 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:57:28.434 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:57:28.441 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:57:28.441 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T01:57:28.448 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-09-12T01:57:28.455 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-09-12T01:57:28.455 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:57:28.455 INFO:teuthology.orchestra.run.smithi100.stdout:Repeating the final host check... 2024-09-12T01:57:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:57:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T01:57:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl is present 2024-09-12T01:57:28.478 INFO:teuthology.orchestra.run.smithi100.stdout:lvcreate is present 2024-09-12T01:57:28.485 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:57:28.485 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:57:28.492 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:57:28.492 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T01:57:28.500 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-09-12T01:57:28.507 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-09-12T01:57:28.508 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:57:28.508 INFO:teuthology.orchestra.run.smithi100.stdout:Host looks OK 2024-09-12T01:57:28.508 INFO:teuthology.orchestra.run.smithi100.stdout:Cluster fsid: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:28.508 INFO:teuthology.orchestra.run.smithi100.stdout:Acquiring lock 140576547173376 on /run/cephadm/3a2902f2-70aa-11ef-bcea-c7b262605968.lock 2024-09-12T01:57:28.508 INFO:teuthology.orchestra.run.smithi100.stdout:Lock 140576547173376 acquired on /run/cephadm/3a2902f2-70aa-11ef-bcea-c7b262605968.lock 2024-09-12T01:57:28.508 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 3300 ... 2024-09-12T01:57:28.509 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 6789 ... 2024-09-12T01:57:28.509 INFO:teuthology.orchestra.run.smithi100.stdout:Base mon IP(s) is [172.21.15.100:3300, 172.21.15.100:6789], mon addrv is [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-12T01:57:28.512 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.100 metric 100 2024-09-12T01:57:28.512 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.100 metric 100 2024-09-12T01:57:28.515 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T01:57:28.515 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T01:57:28.515 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T01:57:28.517 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T01:57:28.518 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T01:57:28.518 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:57:28.518 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T01:57:28.518 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-12T01:57:28.518 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:57:28.518 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-09-12T01:57:28.518 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-09-12T01:57:28.519 INFO:teuthology.orchestra.run.smithi100.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T01:57:28.519 INFO:teuthology.orchestra.run.smithi100.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T01:57:28.520 INFO:teuthology.orchestra.run.smithi100.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:57:28.961 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:57:28.961 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:57:28.961 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T01:57:28.961 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T01:57:28.961 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T01:57:28.961 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:57:28.961 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T01:57:29.908 INFO:teuthology.orchestra.run.smithi100.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:57:29.908 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:57:29.908 INFO:teuthology.orchestra.run.smithi100.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T01:57:30.905 INFO:teuthology.orchestra.run.smithi100.stdout:stat: stdout 167 167 2024-09-12T01:57:30.906 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial keys... 2024-09-12T01:57:31.877 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQCLSuJmDhs7DRAA0Y4DeokDu9g9AqWIUMmwmA== 2024-09-12T01:57:32.800 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQCMSuJmxl6nChAAZJkqAUDu7RG5XpGlHwgpfA== 2024-09-12T01:57:33.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQCNSuJmuuoLBxAAKMhIg2NmZt4SMmNrwUs+Rg== 2024-09-12T01:57:33.682 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial monmap... 2024-09-12T01:57:34.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool for a [v2:172.21.15.100:3300,v1:172.21.15.100:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: set fsid to 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:57:34.672 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mon... 2024-09-12T01:57:35.552 INFO:teuthology.orchestra.run.smithi100.stdout:create mon.a on 2024-09-12T01:57:35.763 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T01:57:35.907 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T01:57:36.080 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968.target. 2024-09-12T01:57:36.080 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968.target. 2024-09-12T01:57:36.330 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:57:36.330 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T01:57:36.492 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968.target.wants/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@.service. 2024-09-12T01:57:36.963 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:36 smithi100 ceph-mon[30818]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:57:36.963 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:36 smithi100 bash[30799]: 7e1acd028c06317e0659b9624f5372edca0aa5369a2e01723c0f501fe13f9de2 2024-09-12T01:57:36.977 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:57:36.977 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T01:57:36.984 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:57:36.984 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T01:57:36.984 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T01:57:36.984 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:57:36.985 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon to start... 2024-09-12T01:57:36.985 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon... 2024-09-12T01:57:37.217 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:36 smithi100 systemd[1]: Started Ceph mon.a for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout id: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout services: 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.567842s) 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:38.012 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout data: 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.429+0000 7f0756b78640 1 Processor -- start 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.429+0000 7f0756b78640 1 -- start start 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.429+0000 7f0756b78640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.429+0000 7f0756b78640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f075007c8c0 con 0x7f075007de90 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.429+0000 7f0754914640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.429+0000 7f0754914640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47700/0 (socket says 172.21.15.100:47700) 2024-09-12T01:57:38.013 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.429+0000 7f0754914640 1 -- 172.21.15.100:0/3547976540 learned_addr learned my addr 172.21.15.100:0/3547976540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.430+0000 7f0754914640 1 -- 172.21.15.100:0/3547976540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075007ca40 con 0x7f075007de90 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.432+0000 7f0754914640 1 --2- 172.21.15.100:0/3547976540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075007c2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0744009820 tx=0x7f074402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f752bbd0d4205cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.432+0000 7f074f7fe640 1 -- 172.21.15.100:0/3547976540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744037070 con 0x7f075007de90 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.432+0000 7f074f7fe640 1 -- 172.21.15.100:0/3547976540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0744032440 con 0x7f075007de90 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.432+0000 7f074f7fe640 1 -- 172.21.15.100:0/3547976540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744032740 con 0x7f075007de90 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 -- 172.21.15.100:0/3547976540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 msgr2=0x7f075007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 --2- 172.21.15.100:0/3547976540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075007c2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0744009820 tx=0x7f074402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 -- 172.21.15.100:0/3547976540 shutdown_connections 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 --2- 172.21.15.100:0/3547976540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075007c2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 -- 172.21.15.100:0/3547976540 >> 172.21.15.100:0/3547976540 conn(0x7f0750102ff0 msgr2=0x7f0750105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 -- 172.21.15.100:0/3547976540 shutdown_connections 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 -- 172.21.15.100:0/3547976540 wait complete. 2024-09-12T01:57:38.014 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 Processor -- start 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 -- start start 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075019d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.433+0000 7f0756b78640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f075007cfe0 con 0x7f075007de90 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f0754914640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075019d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f0754914640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075019d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47704/0 (socket says 172.21.15.100:47704) 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f0754914640 1 -- 172.21.15.100:0/2916029274 learned_addr learned my addr 172.21.15.100:0/2916029274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f0754914640 1 -- 172.21.15.100:0/2916029274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075019d720 con 0x7f075007de90 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f0754914640 1 --2- 172.21.15.100:0/2916029274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075019d1e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f07440090b0 tx=0x7f07440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f074dffb640 1 -- 172.21.15.100:0/2916029274 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744041070 con 0x7f075007de90 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f074dffb640 1 -- 172.21.15.100:0/2916029274 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074403c7a0 con 0x7f075007de90 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075019d9b0 con 0x7f075007de90 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f074dffb640 1 -- 172.21.15.100:0/2916029274 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744037040 con 0x7f075007de90 2024-09-12T01:57:38.015 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.434+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501a06a0 con 0x7f075007de90 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.435+0000 7f074dffb640 1 -- 172.21.15.100:0/2916029274 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0744044070 con 0x7f075007de90 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.435+0000 7f074dffb640 1 -- 172.21.15.100:0/2916029274 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f074403d3f0 con 0x7f075007de90 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.435+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075007c370 con 0x7f075007de90 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.438+0000 7f074dffb640 1 -- 172.21.15.100:0/2916029274 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0744046450 con 0x7f075007de90 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.496+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f075002d910 con 0x7f075007de90 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.496+0000 7f074dffb640 1 -- 172.21.15.100:0/2916029274 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f0744046630 con 0x7f075007de90 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.497+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 msgr2=0x7f075019d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.497+0000 7f0756b78640 1 --2- 172.21.15.100:0/2916029274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075019d1e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f07440090b0 tx=0x7f07440046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.497+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 shutdown_connections 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.497+0000 7f0756b78640 1 --2- 172.21.15.100:0/2916029274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f075007de90 0x7f075019d1e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.497+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 >> 172.21.15.100:0/2916029274 conn(0x7f0750102ff0 msgr2=0x7f0750104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:38.016 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.497+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 shutdown_connections 2024-09-12T01:57:38.017 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:37.497+0000 7f0756b78640 1 -- 172.21.15.100:0/2916029274 wait complete. 2024-09-12T01:57:38.017 INFO:teuthology.orchestra.run.smithi100.stdout:mon is available 2024-09-12T01:57:38.017 INFO:teuthology.orchestra.run.smithi100.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T01:57:38.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: monmap epoch 1 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: last_changed 2024-09-12T01:57:34.038532+0000 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: min_mon_release 19 (squid) 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: election_strategy: 1 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: fsmap 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: mgrmap e1: no daemons active 2024-09-12T01:57:38.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:37 smithi100 ceph-mon[30818]: from='client.? 172.21.15.100:0/2916029274' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T01:57:39.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:38 smithi100 ceph-mon[30818]: from='client.? 172.21.15.100:0/2554229809' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:57:39.043 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:38 smithi100 ceph-mon[30818]: from='client.? 172.21.15.100:0/2554229809' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:39.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.391+0000 7fc322553640 1 Processor -- start 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.391+0000 7fc322553640 1 -- start start 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.391+0000 7fc322553640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c07de90 0x7fc31c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.391+0000 7fc322553640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c07c8c0 con 0x7fc31c07de90 2024-09-12T01:57:39.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.391+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c07de90 0x7fc31c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.391+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c07de90 0x7fc31c07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47716/0 (socket says 172.21.15.100:47716) 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.391+0000 7fc31bfff640 1 -- 172.21.15.100:0/3524332598 learned_addr learned my addr 172.21.15.100:0/3524332598 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.392+0000 7fc31bfff640 1 -- 172.21.15.100:0/3524332598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c07ca40 con 0x7fc31c07de90 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.392+0000 7fc31bfff640 1 --2- 172.21.15.100:0/3524332598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c07de90 0x7fc31c07c2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009820 tx=0x7fc30c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fa02e1a7c1ea62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.392+0000 7fc31affd640 1 -- 172.21.15.100:0/3524332598 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c037070 con 0x7fc31c07de90 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.392+0000 7fc31affd640 1 -- 172.21.15.100:0/3524332598 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c032440 con 0x7fc31c07de90 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.392+0000 7fc31affd640 1 -- 172.21.15.100:0/3524332598 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c032740 con 0x7fc31c07de90 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.393+0000 7fc322553640 1 -- 172.21.15.100:0/3524332598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c07de90 msgr2=0x7fc31c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.393+0000 7fc322553640 1 --2- 172.21.15.100:0/3524332598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c07de90 0x7fc31c07c2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009820 tx=0x7fc30c02a270 comp rx=0 tx=0).stop 2024-09-12T01:57:39.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.393+0000 7fc322553640 1 -- 172.21.15.100:0/3524332598 shutdown_connections 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.393+0000 7fc322553640 1 --2- 172.21.15.100:0/3524332598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c07de90 0x7fc31c07c2f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.393+0000 7fc322553640 1 -- 172.21.15.100:0/3524332598 >> 172.21.15.100:0/3524332598 conn(0x7fc31c102ff0 msgr2=0x7fc31c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.393+0000 7fc322553640 1 -- 172.21.15.100:0/3524332598 shutdown_connections 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.393+0000 7fc322553640 1 -- 172.21.15.100:0/3524332598 wait complete. 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc322553640 1 Processor -- start 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc322553640 1 -- start start 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc322553640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c19d360 0x7fc31c19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc322553640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c07cfe0 con 0x7fc31c19d360 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c19d360 0x7fc31c19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c19d360 0x7fc31c19d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47730/0 (socket says 172.21.15.100:47730) 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc31bfff640 1 -- 172.21.15.100:0/2554229809 learned_addr learned my addr 172.21.15.100:0/2554229809 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc31bfff640 1 -- 172.21.15.100:0/2554229809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c19dcc0 con 0x7fc31c19d360 2024-09-12T01:57:39.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.394+0000 7fc31bfff640 1 --2- 172.21.15.100:0/2554229809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c19d360 0x7fc31c19d780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc30c035040 tx=0x7fc30c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.395+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c041070 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.395+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c03c7a0 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.395+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31c19df50 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.395+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c037040 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.395+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31c1a0a30 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.395+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc30c044070 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.395+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc30c046d10 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.396+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31c07c370 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.398+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc30c046450 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.455+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc31c196d70 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.459+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7fc30c03ca80 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.459+0000 7fc3197fa640 1 -- 172.21.15.100:0/2554229809 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc30c032440 con 0x7fc31c19d360 2024-09-12T01:57:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.460+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c19d360 msgr2=0x7fc31c19d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.460+0000 7fc322553640 1 --2- 172.21.15.100:0/2554229809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c19d360 0x7fc31c19d780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc30c035040 tx=0x7fc30c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.460+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 shutdown_connections 2024-09-12T01:57:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.460+0000 7fc322553640 1 --2- 172.21.15.100:0/2554229809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc31c19d360 0x7fc31c19d780 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.460+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 >> 172.21.15.100:0/2554229809 conn(0x7fc31c102ff0 msgr2=0x7fc31c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.460+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 shutdown_connections 2024-09-12T01:57:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:38.460+0000 7fc322553640 1 -- 172.21.15.100:0/2554229809 wait complete. 2024-09-12T01:57:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:Generating new minimal ceph.conf... 2024-09-12T01:57:40.191 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:39 smithi100 ceph-mon[30818]: from='client.? 172.21.15.100:0/193992902' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:57:40.197 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.432+0000 7f7d77ab8640 1 Processor -- start 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.432+0000 7f7d77ab8640 1 -- start start 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.432+0000 7f7d77ab8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d70108180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.432+0000 7f7d77ab8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70108750 con 0x7f7d70107d80 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.432+0000 7f7d75854640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d70108180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.432+0000 7f7d75854640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d70108180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47740/0 (socket says 172.21.15.100:47740) 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.432+0000 7f7d75854640 1 -- 172.21.15.100:0/3544719097 learned_addr learned my addr 172.21.15.100:0/3544719097 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.433+0000 7f7d75854640 1 -- 172.21.15.100:0/3544719097 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d701088d0 con 0x7f7d70107d80 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.433+0000 7f7d75854640 1 --2- 172.21.15.100:0/3544719097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d70108180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009820 tx=0x7f7d6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379eadefc6e0d3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.433+0000 7f7d74852640 1 -- 172.21.15.100:0/3544719097 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c037070 con 0x7f7d70107d80 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.433+0000 7f7d74852640 1 -- 172.21.15.100:0/3544719097 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d6c032900 con 0x7f7d70107d80 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.433+0000 7f7d74852640 1 -- 172.21.15.100:0/3544719097 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c030850 con 0x7f7d70107d80 2024-09-12T01:57:40.198 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.434+0000 7f7d77ab8640 1 -- 172.21.15.100:0/3544719097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 msgr2=0x7f7d70108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.434+0000 7f7d77ab8640 1 --2- 172.21.15.100:0/3544719097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d70108180 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009820 tx=0x7f7d6c02a270 comp rx=0 tx=0).stop 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.434+0000 7f7d77ab8640 1 -- 172.21.15.100:0/3544719097 shutdown_connections 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.434+0000 7f7d77ab8640 1 --2- 172.21.15.100:0/3544719097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d70108180 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.434+0000 7f7d77ab8640 1 -- 172.21.15.100:0/3544719097 >> 172.21.15.100:0/3544719097 conn(0x7f7d701016b0 msgr2=0x7f7d70103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.434+0000 7f7d77ab8640 1 -- 172.21.15.100:0/3544719097 shutdown_connections 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.434+0000 7f7d77ab8640 1 -- 172.21.15.100:0/3544719097 wait complete. 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d77ab8640 1 Processor -- start 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d77ab8640 1 -- start start 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d77ab8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d7019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.199 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d77ab8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d701067a0 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d75854640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d7019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d75854640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d7019d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47744/0 (socket says 172.21.15.100:47744) 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d75854640 1 -- 172.21.15.100:0/193992902 learned_addr learned my addr 172.21.15.100:0/193992902 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d75854640 1 -- 172.21.15.100:0/193992902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7019df30 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d75854640 1 --2- 172.21.15.100:0/193992902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d7019d9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c032ce0 tx=0x7f7d6c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.435+0000 7f7d66ffd640 1 -- 172.21.15.100:0/193992902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c042070 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.436+0000 7f7d66ffd640 1 -- 172.21.15.100:0/193992902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d6c0308c0 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.436+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7019e1c0 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.436+0000 7f7d66ffd640 1 -- 172.21.15.100:0/193992902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c037040 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.436+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d701a0eb0 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.436+0000 7f7d66ffd640 1 -- 172.21.15.100:0/193992902 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d6c045070 con 0x7f7d70107d80 2024-09-12T01:57:40.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.436+0000 7f7d66ffd640 1 -- 172.21.15.100:0/193992902 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d6c047b70 con 0x7f7d70107d80 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.437+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d70108200 con 0x7f7d70107d80 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.439+0000 7f7d66ffd640 1 -- 172.21.15.100:0/193992902 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7d6c03c720 con 0x7f7d70107d80 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.496+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f7d70196f00 con 0x7f7d70107d80 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.496+0000 7f7d66ffd640 1 -- 172.21.15.100:0/193992902 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f7d6c03c900 con 0x7f7d70107d80 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.497+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 msgr2=0x7f7d7019d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.497+0000 7f7d77ab8640 1 --2- 172.21.15.100:0/193992902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d7019d9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c032ce0 tx=0x7f7d6c032d10 comp rx=0 tx=0).stop 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.497+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 shutdown_connections 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.497+0000 7f7d77ab8640 1 --2- 172.21.15.100:0/193992902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d70107d80 0x7f7d7019d9f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.497+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 >> 172.21.15.100:0/193992902 conn(0x7f7d701016b0 msgr2=0x7f7d70194050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.497+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 shutdown_connections 2024-09-12T01:57:40.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:39.497+0000 7f7d77ab8640 1 -- 172.21.15.100:0/193992902 wait complete. 2024-09-12T01:57:40.202 INFO:teuthology.orchestra.run.smithi100.stdout:Restarting the monitor... 2024-09-12T01:57:40.470 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:40 smithi100 systemd[1]: Stopping Ceph mon.a for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T01:57:40.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a[30814]: 2024-09-12T01:57:40.469+0000 7f4cfca8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:40.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a[30814]: 2024-09-12T01:57:40.469+0000 7f4cfca8e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T01:57:40.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:40 smithi100 podman[31059]: 2024-09-12 01:57:40.623425927 +0000 UTC m=+0.267348896 container died 7e1acd028c06317e0659b9624f5372edca0aa5369a2e01723c0f501fe13f9de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:41.136 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:40 smithi100 podman[31059]: 2024-09-12 01:57:40.919717802 +0000 UTC m=+0.563640771 container cleanup 7e1acd028c06317e0659b9624f5372edca0aa5369a2e01723c0f501fe13f9de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:57:41.136 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:40 smithi100 bash[31059]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:57:41.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 podman[31073]: 2024-09-12 01:57:41.137146924 +0000 UTC m=+0.513783337 container remove 7e1acd028c06317e0659b9624f5372edca0aa5369a2e01723c0f501fe13f9de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:57:41.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 systemd[1]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T01:57:41.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 systemd[1]: Stopped Ceph mon.a for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:57:41.454 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 systemd[1]: Starting Ceph mon.a for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 podman[31160]: 2024-09-12 01:57:41.454778152 +0000 UTC m=+0.106190396 container create ba90479fb30c1c8fa5e6f9ba3472ab62b1ef3cb972ff5fe1885a0193013ea555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 podman[31160]: 2024-09-12 01:57:41.364574683 +0000 UTC m=+0.015986934 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 podman[31160]: 2024-09-12 01:57:41.632087145 +0000 UTC m=+0.283499390 container init ba90479fb30c1c8fa5e6f9ba3472ab62b1ef3cb972ff5fe1885a0193013ea555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 podman[31160]: 2024-09-12 01:57:41.635013661 +0000 UTC m=+0.286425908 container start ba90479fb30c1c8fa5e6f9ba3472ab62b1ef3cb972ff5fe1885a0193013ea555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: pidfile_write: ignore empty --pid-file 2024-09-12T01:57:41.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: load: jerasure load: lrc 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Git sha 0 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: DB SUMMARY 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: DB Session ID: Y31LTEO35A4D12VB1MCC 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T01:57:41.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T01:57:41.717 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106800 ; 2024-09-12T01:57:41.717 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:57:41.718 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:57:41.718 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.env: 0x5594ea06b940 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.info_log: 0x5594ec06d6e0 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:57:41.719 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.statistics: (nil) 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.use_fsync: 0 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:57:41.720 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.db_log_dir: 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.wal_dir: 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:57:41.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.write_buffer_manager: 0x5594ec07cdc0 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.unordered_write: 0 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:57:41.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.row_cache: None 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.wal_filter: None 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.wal_compression: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:57:41.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:57:41.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_open_files: -1 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Compression algorithms supported: 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kZSTD supported: 0 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:57:41.725 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.merge_operator: 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_filter: None 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:57:41.726 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5594ec06d320) 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_type: 0 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: data_block_index_type: 0 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_shortening: 1 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: checksum: 4 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: no_block_cache: 0 2024-09-12T01:57:41.727 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache: 0x5594ec0611f0 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_options: 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: capacity : 536870912 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: num_shard_bits : 4 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: strict_capacity_limit : 0 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_cache_compressed: (nil) 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: persistent_cache: (nil) 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_size: 4096 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_size_deviation: 10 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_restart_interval: 16 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: index_block_restart_interval: 1 2024-09-12T01:57:41.728 INFO:journalctl@ceph.mon.a.smithi100.stdout: metadata_block_size: 4096 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: partition_filters: 0 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: use_delta_encoding: 1 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: filter_policy: bloomfilter 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: whole_key_filtering: 1 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: verify_compression: 0 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: format_version: 5 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: enable_index_compression: 1 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: block_align: 0 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: max_auto_readahead_size: 262144 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: prepopulate_block_cache: 0 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:57:41.729 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression: NoCompression 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.num_levels: 7 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:57:41.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:57:41.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:57:41.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:57:41.733 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:57:41.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.ttl: 2592000 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:57:41.735 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ba8bb37d-657c-4513-a1a0-01ca29ff15fb 2024-09-12T01:57:41.736 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106261662575, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106261663723, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101734, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99619, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14671, "raw_average_key_size": 50, "raw_value_size": 91674, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726106261, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ba8bb37d-657c-4513-a1a0-01ca29ff15fb", "db_session_id": "Y31LTEO35A4D12VB1MCC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106261663817, "job": 1, "event": "recovery_finished"} 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5594ec08ee00 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: DB pointer 0x5594ec18a000 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** DB Stats ** 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:57:41.737 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: L0 2/0 101.21 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: Sum 2/0 101.21 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:57:41.738 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:57:41.739 INFO:journalctl@ceph.mon.a.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: Cumulative compaction: 0.00 GB write, 29.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: Interval compaction: 0.00 GB write, 29.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: Block cache BinnedLRUCache@0x5594ec0611f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: starting mon.a rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???) e1 preinit fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???).mds e1 new map 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???).mds e1 print_map 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: e1 2024-09-12T01:57:41.740 INFO:journalctl@ceph.mon.a.smithi100.stdout: btime 2024-09-12T01:57:36:929801+0000 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout: legacy client fscid: -1 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout: 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout: No filesystems configured 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 bash[31160]: ba90479fb30c1c8fa5e6f9ba3472ab62b1ef3cb972ff5fe1885a0193013ea555 2024-09-12T01:57:41.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 systemd[1]: Started Ceph mon.a for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:57:41.742 INFO:teuthology.orchestra.run.smithi100.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T01:57:42.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: monmap epoch 1 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: last_changed 2024-09-12T01:57:34.038532+0000 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: min_mon_release 19 (squid) 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: election_strategy: 1 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: fsmap 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:57:42.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:41 smithi100 ceph-mon[31179]: mgrmap e1: no daemons active 2024-09-12T01:57:42.753 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.140+0000 7f79276da640 1 Processor -- start 2024-09-12T01:57:42.753 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.140+0000 7f79276da640 1 -- start start 2024-09-12T01:57:42.753 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.140+0000 7f79276da640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.753 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.140+0000 7f79276da640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f792007c7d0 con 0x7f792007dde0 2024-09-12T01:57:42.753 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.141+0000 7f7925476640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.753 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.141+0000 7f7925476640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47746/0 (socket says 172.21.15.100:47746) 2024-09-12T01:57:42.753 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.141+0000 7f7925476640 1 -- 172.21.15.100:0/3920075414 learned_addr learned my addr 172.21.15.100:0/3920075414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.141+0000 7f7925476640 1 -- 172.21.15.100:0/3920075414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792007c950 con 0x7f792007dde0 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.143+0000 7f7925476640 1 --2- 172.21.15.100:0/3920075414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792007c290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f791c009820 tx=0x7f791c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f91b855b1897a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.143+0000 7f7917fff640 1 -- 172.21.15.100:0/3920075414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f791c037070 con 0x7f792007dde0 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.143+0000 7f7917fff640 1 -- 172.21.15.100:0/3920075414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f791c032900 con 0x7f792007dde0 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.143+0000 7f7917fff640 1 -- 172.21.15.100:0/3920075414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f791c030850 con 0x7f792007dde0 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.143+0000 7f79276da640 1 -- 172.21.15.100:0/3920075414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 msgr2=0x7f792007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 --2- 172.21.15.100:0/3920075414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792007c290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f791c009820 tx=0x7f791c02a270 comp rx=0 tx=0).stop 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 -- 172.21.15.100:0/3920075414 shutdown_connections 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 --2- 172.21.15.100:0/3920075414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792007c290 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 -- 172.21.15.100:0/3920075414 >> 172.21.15.100:0/3920075414 conn(0x7f7920103040 msgr2=0x7f7920105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 -- 172.21.15.100:0/3920075414 shutdown_connections 2024-09-12T01:57:42.754 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 -- 172.21.15.100:0/3920075414 wait complete. 2024-09-12T01:57:42.755 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 Processor -- start 2024-09-12T01:57:42.755 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 -- start start 2024-09-12T01:57:42.755 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:42.755 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.144+0000 7f79276da640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f792010de60 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f7925476640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f7925476640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47756/0 (socket says 172.21.15.100:47756) 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f7925476640 1 -- 172.21.15.100:0/2436563110 learned_addr learned my addr 172.21.15.100:0/2436563110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f7925476640 1 -- 172.21.15.100:0/2436563110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792019df10 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f7925476640 1 --2- 172.21.15.100:0/2436563110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792019d9d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f791c032ce0 tx=0x7f791c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f79167fc640 1 -- 172.21.15.100:0/2436563110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f791c042070 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792019e1a0 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f79167fc640 1 -- 172.21.15.100:0/2436563110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f791c0308c0 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f79167fc640 1 -- 172.21.15.100:0/2436563110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f791c037040 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79201a0e90 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f79167fc640 1 -- 172.21.15.100:0/2436563110 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f791c045070 con 0x7f792007dde0 2024-09-12T01:57:42.756 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.145+0000 7f79167fc640 1 -- 172.21.15.100:0/2436563110 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f791c047bc0 con 0x7f792007dde0 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.146+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792007c310 con 0x7f792007dde0 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.148+0000 7f79167fc640 1 -- 172.21.15.100:0/2436563110 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f791c03c830 con 0x7f792007dde0 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.204+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f79201a1480 con 0x7f792007dde0 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.208+0000 7f79167fc640 1 -- 172.21.15.100:0/2436563110 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f791c03ca10 con 0x7f792007dde0 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.209+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 msgr2=0x7f792019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.209+0000 7f79276da640 1 --2- 172.21.15.100:0/2436563110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792019d9d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f791c032ce0 tx=0x7f791c032d10 comp rx=0 tx=0).stop 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.209+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 shutdown_connections 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.209+0000 7f79276da640 1 --2- 172.21.15.100:0/2436563110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792007dde0 0x7f792019d9d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.209+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 >> 172.21.15.100:0/2436563110 conn(0x7f7920103040 msgr2=0x7f7920103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.209+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 shutdown_connections 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:42.209+0000 7f79276da640 1 -- 172.21.15.100:0/2436563110 wait complete. 2024-09-12T01:57:42.757 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T01:57:42.779 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:57:42.779 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mgr... 2024-09-12T01:57:42.779 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T01:57:42.780 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T01:57:43.040 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:57:43.040 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T01:57:43.192 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968.target.wants/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@.service. 2024-09-12T01:57:43.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:43 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2436563110' entity='client.admin' 2024-09-12T01:57:43.319 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 systemd[1]: Starting Ceph mgr.x for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T01:57:43.676 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 podman[31394]: 2024-09-12 01:57:43.415658271 +0000 UTC m=+0.106576199 container create 9d4297736980cd1ec65b6b108cfb27c1e99d686648535d2d016d87dfea6f3014 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T01:57:43.676 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 podman[31394]: 2024-09-12 01:57:43.325049639 +0000 UTC m=+0.015967580 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:57:43.676 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 podman[31394]: 2024-09-12 01:57:43.618305367 +0000 UTC m=+0.309223293 container init 9d4297736980cd1ec65b6b108cfb27c1e99d686648535d2d016d87dfea6f3014 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T01:57:43.676 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 podman[31394]: 2024-09-12 01:57:43.621030955 +0000 UTC m=+0.311948884 container start 9d4297736980cd1ec65b6b108cfb27c1e99d686648535d2d016d87dfea6f3014 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:43.676 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 bash[31394]: 9d4297736980cd1ec65b6b108cfb27c1e99d686648535d2d016d87dfea6f3014 2024-09-12T01:57:43.689 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:57:43.689 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T01:57:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:57:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T01:57:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T01:57:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:57:43.706 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:57:43.706 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T01:57:43.713 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:57:43.714 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T01:57:43.714 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T01:57:43.714 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T01:57:43.714 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr to start... 2024-09-12T01:57:43.714 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr... 2024-09-12T01:57:43.945 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 systemd[1]: Started Ceph mgr.x for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:57:43.945 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:43.745+0000 7fbd4f134040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:57:43.945 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:43.803+0000 7fbd4f134040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:57:44.226 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:43.955+0000 7fbd4f134040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:57:44.226 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:44.023+0000 7fbd4f134040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:57:44.226 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:44.176+0000 7fbd4f134040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:57:44.556 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:44 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/561370895' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:57:44.557 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:44.324+0000 7fbd4f134040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:57:44.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:44.639+0000 7fbd4f134040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:57:44.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:44.700+0000 7fbd4f134040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:57:44.845 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:57:44.846 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:57:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:57:44.848 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:57:44.854 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:57:44.855 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:57:36:929801+0000", 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:57:44.856 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:57:36.930455+0000", 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.157+0000 7f4baa377640 1 Processor -- start 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.158+0000 7f4baa377640 1 -- start start 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.158+0000 7f4baa377640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba4106ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.857 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.158+0000 7f4baa377640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4107080 con 0x7f4ba41066b0 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.158+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba4106ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.158+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba4106ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54862/0 (socket says 172.21.15.100:54862) 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.158+0000 7f4ba3fff640 1 -- 172.21.15.100:0/419912754 learned_addr learned my addr 172.21.15.100:0/419912754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.159+0000 7f4ba3fff640 1 -- 172.21.15.100:0/419912754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba41078b0 con 0x7f4ba41066b0 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.159+0000 7f4ba3fff640 1 --2- 172.21.15.100:0/419912754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba4106ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400bac0 tx=0x7f4b9402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b255d7257bdad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.159+0000 7f4ba37fe640 1 -- 172.21.15.100:0/419912754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b940326d0 con 0x7f4ba41066b0 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.159+0000 7f4ba37fe640 1 -- 172.21.15.100:0/419912754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b94038070 con 0x7f4ba41066b0 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.159+0000 7f4ba37fe640 1 -- 172.21.15.100:0/419912754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b94033d70 con 0x7f4ba41066b0 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.160+0000 7f4baa377640 1 -- 172.21.15.100:0/419912754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 msgr2=0x7f4ba4106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.160+0000 7f4baa377640 1 --2- 172.21.15.100:0/419912754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba4106ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400bac0 tx=0x7f4b9402c920 comp rx=0 tx=0).stop 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.160+0000 7f4baa377640 1 -- 172.21.15.100:0/419912754 shutdown_connections 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.160+0000 7f4baa377640 1 --2- 172.21.15.100:0/419912754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba4106ab0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.160+0000 7f4baa377640 1 -- 172.21.15.100:0/419912754 >> 172.21.15.100:0/419912754 conn(0x7f4ba4101e60 msgr2=0x7f4ba4104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.160+0000 7f4baa377640 1 -- 172.21.15.100:0/419912754 shutdown_connections 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.160+0000 7f4baa377640 1 -- 172.21.15.100:0/419912754 wait complete. 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4baa377640 1 Processor -- start 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4baa377640 1 -- start start 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4baa377640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba41995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4baa377640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba407b100 con 0x7f4ba41066b0 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba41995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba41995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54864/0 (socket says 172.21.15.100:54864) 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4ba3fff640 1 -- 172.21.15.100:0/561370895 learned_addr learned my addr 172.21.15.100:0/561370895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.161+0000 7f4ba3fff640 1 -- 172.21.15.100:0/561370895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba4199af0 con 0x7f4ba41066b0 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4ba3fff640 1 --2- 172.21.15.100:0/561370895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba41995b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400b2c0 tx=0x7f4b940327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4ba1ffb640 1 -- 172.21.15.100:0/561370895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b94042070 con 0x7f4ba41066b0 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba4199d80 con 0x7f4ba41066b0 2024-09-12T01:57:44.859 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4ba1ffb640 1 -- 172.21.15.100:0/561370895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b94032b70 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba419ca70 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4ba1ffb640 1 -- 172.21.15.100:0/561370895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b9403c580 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4ba1ffb640 1 -- 172.21.15.100:0/561370895 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b94005990 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.162+0000 7f4ba1ffb640 1 -- 172.21.15.100:0/561370895 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4b94030050 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.163+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba4106ab0 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.165+0000 7f4ba1ffb640 1 -- 172.21.15.100:0/561370895 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4b94054080 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.226+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4ba4192a20 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.226+0000 7f4ba1ffb640 1 -- 172.21.15.100:0/561370895 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4b94032d20 con 0x7f4ba41066b0 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.227+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 msgr2=0x7f4ba41995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.227+0000 7f4baa377640 1 --2- 172.21.15.100:0/561370895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba41995b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400b2c0 tx=0x7f4b940327d0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.227+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 shutdown_connections 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.227+0000 7f4baa377640 1 --2- 172.21.15.100:0/561370895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41066b0 0x7f4ba41995b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.227+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 >> 172.21.15.100:0/561370895 conn(0x7f4ba4101e60 msgr2=0x7f4ba418fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:44.860 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.227+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 shutdown_connections 2024-09-12T01:57:44.861 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:44.227+0000 7f4baa377640 1 -- 172.21.15.100:0/561370895 wait complete. 2024-09-12T01:57:44.861 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (1/15)... 2024-09-12T01:57:45.318 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:44.891+0000 7fbd4f134040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:57:46.068 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:45 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:45.760+0000 7fbd4f134040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:57:46.068 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:45 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:45.827+0000 7fbd4f134040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:57:46.807 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:46 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:46.551+0000 7fbd4f134040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:57:46.807 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:46 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:46.667+0000 7fbd4f134040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:57:46.807 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:46 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:46.807+0000 7fbd4f134040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:57:47.068 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:46 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:46.871+0000 7fbd4f134040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:57:47.068 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.024+0000 7fbd4f134040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:57:47.339 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.095+0000 7fbd4f134040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:57:47.339 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.155+0000 7fbd4f134040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:57:47.339 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.320+0000 7fbd4f134040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:57:47.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1501473542' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:57:47.604 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.391+0000 7fbd4f134040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:57:47.604 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.458+0000 7fbd4f134040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:57:47.604 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.540+0000 7fbd4f134040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:57:47.906 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.604+0000 7fbd4f134040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:57:47.906 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:47.665+0000 7fbd4f134040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:57:47.918 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:47.918 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:57:47.918 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T01:57:47.918 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:47.919 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:57:47.920 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:47.921 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:57:36:929801+0000", 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:57:47.922 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:57:36.930455+0000", 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.271+0000 7f618d8af640 1 Processor -- start 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.271+0000 7f618d8af640 1 -- start start 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.271+0000 7f618d8af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f618810a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.271+0000 7f618d8af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f618807be00 con 0x7f6188108280 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.271+0000 7f6186ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f618810a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.923 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.271+0000 7f6186ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f618810a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54872/0 (socket says 172.21.15.100:54872) 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.271+0000 7f6186ffd640 1 -- 172.21.15.100:0/689409382 learned_addr learned my addr 172.21.15.100:0/689409382 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.272+0000 7f6186ffd640 1 -- 172.21.15.100:0/689409382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618810abb0 con 0x7f6188108280 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.272+0000 7f6186ffd640 1 --2- 172.21.15.100:0/689409382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f618810a670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6178009820 tx=0x7f617802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d9fd0f15852aab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f6185ffb640 1 -- 172.21.15.100:0/689409382 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178037070 con 0x7f6188108280 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f6185ffb640 1 -- 172.21.15.100:0/689409382 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6178032900 con 0x7f6188108280 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f6185ffb640 1 -- 172.21.15.100:0/689409382 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178030850 con 0x7f6188108280 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f618d8af640 1 -- 172.21.15.100:0/689409382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 msgr2=0x7f618810a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f618d8af640 1 --2- 172.21.15.100:0/689409382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f618810a670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6178009820 tx=0x7f617802a270 comp rx=0 tx=0).stop 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f618d8af640 1 -- 172.21.15.100:0/689409382 shutdown_connections 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f618d8af640 1 --2- 172.21.15.100:0/689409382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f618810a670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f618d8af640 1 -- 172.21.15.100:0/689409382 >> 172.21.15.100:0/689409382 conn(0x7f6188101e60 msgr2=0x7f6188104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f618d8af640 1 -- 172.21.15.100:0/689409382 shutdown_connections 2024-09-12T01:57:47.924 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.273+0000 7f618d8af640 1 -- 172.21.15.100:0/689409382 wait complete. 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.274+0000 7f618d8af640 1 Processor -- start 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.274+0000 7f618d8af640 1 -- start start 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.274+0000 7f618d8af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f6188107b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.274+0000 7f618d8af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f618810bbf0 con 0x7f6188108280 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.274+0000 7f6186ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f6188107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.274+0000 7f6186ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f6188107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54878/0 (socket says 172.21.15.100:54878) 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.274+0000 7f6186ffd640 1 -- 172.21.15.100:0/1501473542 learned_addr learned my addr 172.21.15.100:0/1501473542 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f6186ffd640 1 -- 172.21.15.100:0/1501473542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6188108040 con 0x7f6188108280 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f6186ffd640 1 --2- 172.21.15.100:0/1501473542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f6188107b00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61780097f0 tx=0x7f6178030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f618c8ad640 1 -- 172.21.15.100:0/1501473542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178037040 con 0x7f6188108280 2024-09-12T01:57:47.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6188106230 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f618c8ad640 1 -- 172.21.15.100:0/1501473542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6178040070 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f618c8ad640 1 -- 172.21.15.100:0/1501473542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617803a390 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6188106710 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f618c8ad640 1 -- 172.21.15.100:0/1501473542 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f617803a6b0 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.275+0000 7f618c8ad640 1 -- 172.21.15.100:0/1501473542 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6178045a00 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.276+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61881086e0 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.278+0000 7f618c8ad640 1 -- 172.21.15.100:0/1501473542 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6178045460 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.339+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6188106c40 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.340+0000 7f618c8ad640 1 -- 172.21.15.100:0/1501473542 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f617803b430 con 0x7f6188108280 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.341+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 msgr2=0x7f6188107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.341+0000 7f618d8af640 1 --2- 172.21.15.100:0/1501473542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f6188107b00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61780097f0 tx=0x7f6178030d80 comp rx=0 tx=0).stop 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.341+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 shutdown_connections 2024-09-12T01:57:47.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.341+0000 7f618d8af640 1 --2- 172.21.15.100:0/1501473542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6188108280 0x7f6188107b00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.341+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 >> 172.21.15.100:0/1501473542 conn(0x7f6188101e60 msgr2=0x7f6188102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.341+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 shutdown_connections 2024-09-12T01:57:47.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:47.341+0000 7f618d8af640 1 -- 172.21.15.100:0/1501473542 wait complete. 2024-09-12T01:57:47.927 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (2/15)... 2024-09-12T01:57:48.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:48.456+0000 7fbd4f134040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:57:48.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: Activating manager daemon x 2024-09-12T01:57:48.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: mgrmap e2: x(active, starting, since 0.00309173s) 2024-09-12T01:57:48.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: Manager daemon x is now available 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' 2024-09-12T01:57:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:48 smithi100 ceph-mon[31179]: from='mgr.14100 172.21.15.100:0/4153945958' entity='mgr.x' 2024-09-12T01:57:50.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:50 smithi100 ceph-mon[31179]: mgrmap e3: x(active, since 1.0074s) 2024-09-12T01:57:51.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:51.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:57:51.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T01:57:51.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:57:51.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:57:51.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:57:51.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:57:51.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:57:51.129 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:57:51.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:57:36:929801+0000", 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:57:51.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:57:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:57:36.930455+0000", 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.325+0000 7f491a1aa640 1 Processor -- start 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.325+0000 7f491a1aa640 1 -- start start 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.325+0000 7f491a1aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491407c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.325+0000 7f491a1aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f491407c8a0 con 0x7f491407de20 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.325+0000 7f49137fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491407c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.133 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.325+0000 7f49137fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491407c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54960/0 (socket says 172.21.15.100:54960) 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.325+0000 7f49137fe640 1 -- 172.21.15.100:0/881951378 learned_addr learned my addr 172.21.15.100:0/881951378 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.326+0000 7f49137fe640 1 -- 172.21.15.100:0/881951378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491407ca20 con 0x7f491407de20 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.326+0000 7f49137fe640 1 --2- 172.21.15.100:0/881951378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491407c2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4904009820 tx=0x7f490402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5952638dfac3d344 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f49127fc640 1 -- 172.21.15.100:0/881951378 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904037070 con 0x7f491407de20 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f49127fc640 1 -- 172.21.15.100:0/881951378 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4904032900 con 0x7f491407de20 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f49127fc640 1 -- 172.21.15.100:0/881951378 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904030850 con 0x7f491407de20 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f491a1aa640 1 -- 172.21.15.100:0/881951378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 msgr2=0x7f491407c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f491a1aa640 1 --2- 172.21.15.100:0/881951378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491407c2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4904009820 tx=0x7f490402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f491a1aa640 1 -- 172.21.15.100:0/881951378 shutdown_connections 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f491a1aa640 1 --2- 172.21.15.100:0/881951378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491407c2d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f491a1aa640 1 -- 172.21.15.100:0/881951378 >> 172.21.15.100:0/881951378 conn(0x7f4914103040 msgr2=0x7f4914105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f491a1aa640 1 -- 172.21.15.100:0/881951378 shutdown_connections 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.327+0000 7f491a1aa640 1 -- 172.21.15.100:0/881951378 wait complete. 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.328+0000 7f491a1aa640 1 Processor -- start 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.328+0000 7f491a1aa640 1 -- start start 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.328+0000 7f491a1aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491419d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.328+0000 7f491a1aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f491410de20 con 0x7f491407de20 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f49137fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491419d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f49137fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491419d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54964/0 (socket says 172.21.15.100:54964) 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f49137fe640 1 -- 172.21.15.100:0/3961691343 learned_addr learned my addr 172.21.15.100:0/3961691343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f49137fe640 1 -- 172.21.15.100:0/3961691343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491419df20 con 0x7f491407de20 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f49137fe640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491419d9e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f49040097f0 tx=0x7f4904030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904037040 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4904040070 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f491419e1b0 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490403a390 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.329+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49141a0ea0 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.330+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f490403a630 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.330+0000 7f4910ff9640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f48fc038e10 0x7f48fc03b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.330+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f491407c350 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.330+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f490406bf10 con 0x7f491407de20 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.330+0000 7f4912ffd640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f48fc038e10 0x7f48fc03b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.331+0000 7f4912ffd640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f48fc038e10 0x7f48fc03b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49080098c0 tx=0x7f4908006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.335+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4904043760 con 0x7f491407de20 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.467+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f490402fd40 con 0x7f491407de20 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.569+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f49141a1070 con 0x7f491407de20 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.570+0000 7f4910ff9640 1 -- 172.21.15.100:0/3961691343 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f49040392f0 con 0x7f491407de20 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f48fc038e10 msgr2=0x7f48fc03b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f48fc038e10 0x7f48fc03b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49080098c0 tx=0x7f4908006db0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 msgr2=0x7f491419d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491419d9e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f49040097f0 tx=0x7f4904030d80 comp rx=0 tx=0).stop 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 shutdown_connections 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f48fc038e10 0x7f48fc03b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 --2- 172.21.15.100:0/3961691343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491407de20 0x7f491419d9e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 >> 172.21.15.100:0/3961691343 conn(0x7f4914103040 msgr2=0x7f4914103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 shutdown_connections 2024-09-12T01:57:51.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:50.572+0000 7f491a1aa640 1 -- 172.21.15.100:0/3961691343 wait complete. 2024-09-12T01:57:51.138 INFO:teuthology.orchestra.run.smithi100.stdout:mgr is available 2024-09-12T01:57:51.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:51 smithi100 ceph-mon[31179]: mgrmap e4: x(active, since 2s) 2024-09-12T01:57:51.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:51 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3961691343' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:57:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:57:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd28c66640 1 Processor -- start 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd28c66640 1 -- start start 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd28c66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd24106ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd28c66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24107080 con 0x7fcd241066b0 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd2259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd24106ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd2259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd24106ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54974/0 (socket says 172.21.15.100:54974) 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd2259c640 1 -- 172.21.15.100:0/4175075553 learned_addr learned my addr 172.21.15.100:0/4175075553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.466+0000 7fcd2259c640 1 -- 172.21.15.100:0/4175075553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd241078b0 con 0x7fcd241066b0 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.467+0000 7fcd2259c640 1 --2- 172.21.15.100:0/4175075553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd24106ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009820 tx=0x7fcd1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9851b897d9178bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd21d9b640 1 -- 172.21.15.100:0/4175075553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd14037070 con 0x7fcd241066b0 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd21d9b640 1 -- 172.21.15.100:0/4175075553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd14032900 con 0x7fcd241066b0 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd21d9b640 1 -- 172.21.15.100:0/4175075553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd14030850 con 0x7fcd241066b0 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd28c66640 1 -- 172.21.15.100:0/4175075553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 msgr2=0x7fcd24106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd28c66640 1 --2- 172.21.15.100:0/4175075553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd24106ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009820 tx=0x7fcd1402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd28c66640 1 -- 172.21.15.100:0/4175075553 shutdown_connections 2024-09-12T01:57:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd28c66640 1 --2- 172.21.15.100:0/4175075553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd24106ab0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd28c66640 1 -- 172.21.15.100:0/4175075553 >> 172.21.15.100:0/4175075553 conn(0x7fcd24101e60 msgr2=0x7fcd24104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd28c66640 1 -- 172.21.15.100:0/4175075553 shutdown_connections 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.469+0000 7fcd28c66640 1 -- 172.21.15.100:0/4175075553 wait complete. 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.470+0000 7fcd28c66640 1 Processor -- start 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.470+0000 7fcd28c66640 1 -- start start 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.470+0000 7fcd28c66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd2407ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.470+0000 7fcd28c66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2410ac60 con 0x7fcd241066b0 2024-09-12T01:57:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd2259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd2407ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd2259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd2407ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54984/0 (socket says 172.21.15.100:54984) 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd2259c640 1 -- 172.21.15.100:0/4221282526 learned_addr learned my addr 172.21.15.100:0/4221282526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd2259c640 1 -- 172.21.15.100:0/4221282526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2419c340 con 0x7fcd241066b0 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd2259c640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd2407ba00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097f0 tx=0x7fcd14030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd1bfff640 1 -- 172.21.15.100:0/4221282526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd14037040 con 0x7fcd241066b0 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd241a0950 con 0x7fcd241066b0 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd1bfff640 1 -- 172.21.15.100:0/4221282526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd14040070 con 0x7fcd241066b0 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd1bfff640 1 -- 172.21.15.100:0/4221282526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd1403a390 con 0x7fcd241066b0 2024-09-12T01:57:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.471+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd241a0cf0 con 0x7fcd241066b0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.472+0000 7fcd1bfff640 1 -- 172.21.15.100:0/4221282526 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fcd1403a630 con 0x7fcd241066b0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.472+0000 7fcd1bfff640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fcd10038f20 0x7fcd1003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.472+0000 7fcd1bfff640 1 -- 172.21.15.100:0/4221282526 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd1406d1a0 con 0x7fcd241066b0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.472+0000 7fcd19d9b640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fcd10038f20 0x7fcd1003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.472+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd24106b30 con 0x7fcd241066b0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.473+0000 7fcd19d9b640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fcd10038f20 0x7fcd1003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0098c0 tx=0x7fcd0c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.477+0000 7fcd1bfff640 1 -- 172.21.15.100:0/4221282526 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd1406cf00 con 0x7fcd241066b0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.643+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fcd241a25f0 con 0x7fcd241066b0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.644+0000 7fcd1bfff640 1 -- 172.21.15.100:0/4221282526 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7fcd1403a920 con 0x7fcd241066b0 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fcd10038f20 msgr2=0x7fcd1003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fcd10038f20 0x7fcd1003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0098c0 tx=0x7fcd0c006db0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 msgr2=0x7fcd2407ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd2407ba00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097f0 tx=0x7fcd14030d80 comp rx=0 tx=0).stop 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 shutdown_connections 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fcd10038f20 0x7fcd1003b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 --2- 172.21.15.100:0/4221282526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd241066b0 0x7fcd2407ba00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 >> 172.21.15.100:0/4221282526 conn(0x7fcd24101e60 msgr2=0x7fcd241029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 shutdown_connections 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:51.646+0000 7fcd28c66640 1 -- 172.21.15.100:0/4221282526 wait complete. 2024-09-12T01:57:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling cephadm module... 2024-09-12T01:57:52.768 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:52 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4221282526' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:57:53.783 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:53 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1022807723' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T01:57:53.783 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: ignoring --setuser ceph since I am not root 2024-09-12T01:57:53.783 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: ignoring --setgroup ceph since I am not root 2024-09-12T01:57:53.783 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:53.611+0000 7f936974f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:57:53.783 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:53.667+0000 7f936974f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:57:54.066 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:53.816+0000 7f936974f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:57:54.067 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:53.881+0000 7f936974f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:57:54.067 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:54.031+0000 7f936974f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.548+0000 7f46da490640 1 Processor -- start 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.549+0000 7f46da490640 1 -- start start 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.549+0000 7f46da490640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.549+0000 7f46da490640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46d407c8c0 con 0x7f46d407de90 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.549+0000 7f46d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.549+0000 7f46d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54986/0 (socket says 172.21.15.100:54986) 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.549+0000 7f46d3fff640 1 -- 172.21.15.100:0/3667561038 learned_addr learned my addr 172.21.15.100:0/3667561038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.549+0000 7f46d3fff640 1 -- 172.21.15.100:0/3667561038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d407ca40 con 0x7f46d407de90 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.550+0000 7f46d3fff640 1 --2- 172.21.15.100:0/3667561038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d407c2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009820 tx=0x7f46c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4133cd39daff0899 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.550+0000 7f46d37fe640 1 -- 172.21.15.100:0/3667561038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4037070 con 0x7f46d407de90 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.550+0000 7f46d37fe640 1 -- 172.21.15.100:0/3667561038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46c4032900 con 0x7f46d407de90 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.550+0000 7f46d37fe640 1 -- 172.21.15.100:0/3667561038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4030850 con 0x7f46d407de90 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.550+0000 7f46da490640 1 -- 172.21.15.100:0/3667561038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 msgr2=0x7f46d407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.550+0000 7f46da490640 1 --2- 172.21.15.100:0/3667561038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d407c2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009820 tx=0x7f46c402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 -- 172.21.15.100:0/3667561038 shutdown_connections 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 --2- 172.21.15.100:0/3667561038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d407c2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 -- 172.21.15.100:0/3667561038 >> 172.21.15.100:0/3667561038 conn(0x7f46d4102ff0 msgr2=0x7f46d4105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 -- 172.21.15.100:0/3667561038 shutdown_connections 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 -- 172.21.15.100:0/3667561038 wait complete. 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 Processor -- start 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 -- start start 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d419da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46da490640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46d410de30 con 0x7f46d407de90 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d419da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d419da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54992/0 (socket says 172.21.15.100:54992) 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.551+0000 7f46d3fff640 1 -- 172.21.15.100:0/1022807723 learned_addr learned my addr 172.21.15.100:0/1022807723 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.552+0000 7f46d3fff640 1 -- 172.21.15.100:0/1022807723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d419dfd0 con 0x7f46d407de90 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.552+0000 7f46d3fff640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d419da90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009940 tx=0x7f46c40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.552+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4042070 con 0x7f46d407de90 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.552+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d419e260 con 0x7f46d407de90 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.552+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46c4032be0 con 0x7f46d407de90 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.552+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4037040 con 0x7f46d407de90 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.552+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d41a0f50 con 0x7f46d407de90 2024-09-12T01:57:54.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.553+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f46c4045070 con 0x7f46d407de90 2024-09-12T01:57:54.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.553+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d407c370 con 0x7f46d407de90 2024-09-12T01:57:54.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.553+0000 7f46d1ffb640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f46c0038f20 0x7f46c003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.553+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f46c406bfd0 con 0x7f46d407de90 2024-09-12T01:57:54.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.553+0000 7f46cbfff640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f46c0038f20 0x7f46c003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.553+0000 7f46cbfff640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f46c0038f20 0x7f46c003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0098c0 tx=0x7f46bc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.077 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.558+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46c406b9f0 con 0x7f46d407de90 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:52.768+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f46d41a15d0 con 0x7f46d407de90 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.471+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f46c403b330 con 0x7f46d407de90 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.472+0000 7f46d1ffb640 1 -- 172.21.15.100:0/1022807723 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f46c405a6f0 con 0x7f46d407de90 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.473+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f46c0038f20 msgr2=0x7f46c003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.473+0000 7f46da490640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f46c0038f20 0x7f46c003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0098c0 tx=0x7f46bc006db0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 msgr2=0x7f46d419da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d419da90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009940 tx=0x7f46c40326e0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 shutdown_connections 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f46c0038f20 0x7f46c003b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 --2- 172.21.15.100:0/1022807723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d407de90 0x7f46d419da90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 >> 172.21.15.100:0/1022807723 conn(0x7f46d4102ff0 msgr2=0x7f46d4103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.078 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 shutdown_connections 2024-09-12T01:57:54.079 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:53.474+0000 7f46da490640 1 -- 172.21.15.100:0/1022807723 wait complete. 2024-09-12T01:57:54.318 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:54.177+0000 7f936974f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:57:54.679 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:54 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1022807723' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T01:57:54.679 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:54 smithi100 ceph-mon[31179]: mgrmap e5: x(active, since 5s) 2024-09-12T01:57:54.679 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:54.498+0000 7f936974f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:57:54.679 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:54.560+0000 7f936974f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:57:54.997 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:54.749+0000 7f936974f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:57:55.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:57:55.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T01:57:55.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:57:55.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:57:55.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:57:55.290 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8233f00640 1 Processor -- start 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8233f00640 1 -- start start 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8233f00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c106aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8233f00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f822c107070 con 0x7f822c1066a0 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8231c9c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c106aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8231c9c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c106aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56434/0 (socket says 172.21.15.100:56434) 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8231c9c640 1 -- 172.21.15.100:0/3622254055 learned_addr learned my addr 172.21.15.100:0/3622254055 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.472+0000 7f8231c9c640 1 -- 172.21.15.100:0/3622254055 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c1078a0 con 0x7f822c1066a0 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.474+0000 7f8231c9c640 1 --2- 172.21.15.100:0/3622254055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c106aa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8228009820 tx=0x7f822802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf59cc03838f340 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.474+0000 7f8230c9a640 1 -- 172.21.15.100:0/3622254055 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8228037070 con 0x7f822c1066a0 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.474+0000 7f8230c9a640 1 -- 172.21.15.100:0/3622254055 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8228032900 con 0x7f822c1066a0 2024-09-12T01:57:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.474+0000 7f8230c9a640 1 -- 172.21.15.100:0/3622254055 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8228030850 con 0x7f822c1066a0 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.474+0000 7f8233f00640 1 -- 172.21.15.100:0/3622254055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 msgr2=0x7f822c106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.474+0000 7f8233f00640 1 --2- 172.21.15.100:0/3622254055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c106aa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8228009820 tx=0x7f822802a270 comp rx=0 tx=0).stop 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 -- 172.21.15.100:0/3622254055 shutdown_connections 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 --2- 172.21.15.100:0/3622254055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c106aa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 -- 172.21.15.100:0/3622254055 >> 172.21.15.100:0/3622254055 conn(0x7f822c101e70 msgr2=0x7f822c104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 -- 172.21.15.100:0/3622254055 shutdown_connections 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 -- 172.21.15.100:0/3622254055 wait complete. 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 Processor -- start 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 -- start start 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.475+0000 7f8233f00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f822c10ac50 con 0x7f822c1066a0 2024-09-12T01:57:55.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8231c9c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8231c9c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56442/0 (socket says 172.21.15.100:56442) 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8231c9c640 1 -- 172.21.15.100:0/2648441637 learned_addr learned my addr 172.21.15.100:0/2648441637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8231c9c640 1 -- 172.21.15.100:0/2648441637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c19bde0 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8231c9c640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c19b8a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82280097f0 tx=0x7f8228030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8222ffd640 1 -- 172.21.15.100:0/2648441637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8228042070 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8222ffd640 1 -- 172.21.15.100:0/2648441637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8228032ca0 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c19c070 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8222ffd640 1 -- 172.21.15.100:0/2648441637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8228037040 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.476+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c19ed60 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.477+0000 7f8222ffd640 1 -- 172.21.15.100:0/2648441637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f8228045070 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.477+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822c10add0 con 0x7f822c1066a0 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.478+0000 7f8222ffd640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 0x7f821803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.478+0000 7f8222ffd640 1 -- 172.21.15.100:0/2648441637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f822806beb0 con 0x7f822c1066a0 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.478+0000 7f823149b640 1 -- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 msgr2=0x7f821803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2932456441 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.478+0000 7f823149b640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 0x7f821803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.482+0000 7f8222ffd640 1 -- 172.21.15.100:0/2648441637 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8228045360 con 0x7f822c1066a0 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.679+0000 7f823149b640 1 -- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 msgr2=0x7f821803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2932456441 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.679+0000 7f823149b640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 0x7f821803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.697+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f822c02da30 con 0x7f822c1066a0 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.698+0000 7f8222ffd640 1 -- 172.21.15.100:0/2648441637 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f822806b8d0 con 0x7f822c1066a0 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 msgr2=0x7f821803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 0x7f821803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 msgr2=0x7f822c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c19b8a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82280097f0 tx=0x7f8228030ec0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 shutdown_connections 2024-09-12T01:57:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7f8218038fc0 0x7f821803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 --2- 172.21.15.100:0/2648441637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c1066a0 0x7f822c19b8a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 >> 172.21.15.100:0/2648441637 conn(0x7f822c101e70 msgr2=0x7f822c102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 shutdown_connections 2024-09-12T01:57:55.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:54.700+0000 7f8233f00640 1 -- 172.21.15.100:0/2648441637 wait complete. 2024-09-12T01:57:55.295 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-09-12T01:57:55.295 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 5... 2024-09-12T01:57:55.537 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:55 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2648441637' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:57:55.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:55 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:55.642+0000 7f936974f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:57:55.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:55 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:55.713+0000 7f936974f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:57:56.680 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:56.420+0000 7f936974f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:57:56.680 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:56.537+0000 7f936974f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:57:56.955 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:56.680+0000 7f936974f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:57:56.956 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:56.741+0000 7f936974f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:57:56.956 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:56.888+0000 7f936974f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:57:56.956 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:56.955+0000 7f936974f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:57:57.237 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:57.016+0000 7f936974f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:57:57.237 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:57.173+0000 7f936974f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:57:57.237 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:57.237+0000 7f936974f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:57:57.499 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:57.303+0000 7f936974f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:57:57.499 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:57.384+0000 7f936974f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:57:57.500 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:57.442+0000 7f936974f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:57:57.500 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:57.499+0000 7f936974f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:57:58.568 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:57:58.284+0000 7f936974f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:57:58.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: Active manager daemon x restarted 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: Activating manager daemon x 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: mgrmap e6: x(active, starting, since 0.0032606s) 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: Manager daemon x is now available 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:58.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:57:58.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:58 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:57:59.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:59 smithi100 ceph-mon[31179]: Found migration_current of "None". Setting to last migration. 2024-09-12T01:57:59.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:57:59 smithi100 ceph-mon[31179]: mgrmap e7: x(active, since 1.00532s) 2024-09-12T01:57:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:57:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.713+0000 7fbaac73f640 1 Processor -- start 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.713+0000 7fbaac73f640 1 -- start start 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.713+0000 7fbaac73f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa4106ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.713+0000 7fbaac73f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4107090 con 0x7fbaa41066c0 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.713+0000 7fbaaa4db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa4106ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.713+0000 7fbaaa4db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa4106ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56446/0 (socket says 172.21.15.100:56446) 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.713+0000 7fbaaa4db640 1 -- 172.21.15.100:0/580732312 learned_addr learned my addr 172.21.15.100:0/580732312 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.714+0000 7fbaaa4db640 1 -- 172.21.15.100:0/580732312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41078c0 con 0x7fbaa41066c0 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.714+0000 7fbaaa4db640 1 --2- 172.21.15.100:0/580732312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa4106ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba94009820 tx=0x7fba9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3215c3e59e5ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaa94d9640 1 -- 172.21.15.100:0/580732312 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94037070 con 0x7fbaa41066c0 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaa94d9640 1 -- 172.21.15.100:0/580732312 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba94032900 con 0x7fbaa41066c0 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaa94d9640 1 -- 172.21.15.100:0/580732312 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94030850 con 0x7fbaa41066c0 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaac73f640 1 -- 172.21.15.100:0/580732312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 msgr2=0x7fbaa4106ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaac73f640 1 --2- 172.21.15.100:0/580732312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa4106ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba94009820 tx=0x7fba9402a270 comp rx=0 tx=0).stop 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaac73f640 1 -- 172.21.15.100:0/580732312 shutdown_connections 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaac73f640 1 --2- 172.21.15.100:0/580732312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa4106ac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaac73f640 1 -- 172.21.15.100:0/580732312 >> 172.21.15.100:0/580732312 conn(0x7fbaa4101e90 msgr2=0x7fbaa41042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaac73f640 1 -- 172.21.15.100:0/580732312 shutdown_connections 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.715+0000 7fbaac73f640 1 -- 172.21.15.100:0/580732312 wait complete. 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaac73f640 1 Processor -- start 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaac73f640 1 -- start start 2024-09-12T01:57:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaac73f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaac73f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa410ac70 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaaa4db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaaa4db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa419b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56460/0 (socket says 172.21.15.100:56460) 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaaa4db640 1 -- 172.21.15.100:0/4165688679 learned_addr learned my addr 172.21.15.100:0/4165688679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.716+0000 7fbaaa4db640 1 -- 172.21.15.100:0/4165688679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa419bda0 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.717+0000 7fbaaa4db640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa419b860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba94009940 tx=0x7fba940326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.717+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94042070 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.717+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa419c030 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.717+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba94032be0 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.717+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94037040 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.717+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa419ed20 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.718+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fba94045070 con 0x7fbaa41066c0 2024-09-12T01:57:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.718+0000 7fba9b7fe640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 0x7fba9003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.718+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 --> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbaa4106b40 con 0x7fba90038f70 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.718+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba9406bfa0 con 0x7fbaa41066c0 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.718+0000 7fbaa9cda640 1 -- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 msgr2=0x7fba9003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2932456441 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.718+0000 7fbaa9cda640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 0x7fba9003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.919+0000 7fbaa9cda640 1 -- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 msgr2=0x7fba9003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2932456441 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:55.919+0000 7fbaa9cda640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 0x7fba9003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:56.320+0000 7fbaa9cda640 1 -- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 msgr2=0x7fba9003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2932456441 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:56.320+0000 7fbaa9cda640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 0x7fba9003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:57.121+0000 7fbaa9cda640 1 -- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 msgr2=0x7fba9003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2932456441 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:57.121+0000 7fbaa9cda640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 0x7fba9003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:58.287+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fba9406ab20 con 0x7fbaa41066c0 2024-09-12T01:57:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:58.287+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 msgr2=0x7fba9003b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:58.287+0000 7fba9b7fe640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 0x7fba9003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.287+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fba9403b330 con 0x7fbaa41066c0 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.287+0000 7fba9b7fe640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fba9003c6b0 0x7fba9003eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.287+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbaa4106b40 con 0x7fba9003c6b0 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.288+0000 7fbaa9cda640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fba9003c6b0 0x7fba9003eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.288+0000 7fbaa9cda640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fba9003c6b0 0x7fba9003eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0003980 tx=0x7fbaa0006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.289+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fbaa4106b40 con 0x7fba9003c6b0 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fbaa410adf0 con 0x7fba9003c6b0 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fba9b7fe640 1 -- 172.21.15.100:0/4165688679 <== mgr.14118 v2:172.21.15.100:6800/824408405 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fbaa410adf0 con 0x7fba9003c6b0 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fba9003c6b0 msgr2=0x7fba9003eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fba9003c6b0 0x7fba9003eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0003980 tx=0x7fbaa0006e10 comp rx=0 tx=0).stop 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 msgr2=0x7fbaa419b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa419b860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba94009940 tx=0x7fba940326e0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 shutdown_connections 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fba9003c6b0 0x7fba9003eaa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:6800/2932456441,v1:172.21.15.100:6801/2932456441] conn(0x7fba90038f70 0x7fba9003b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 --2- 172.21.15.100:0/4165688679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa41066c0 0x7fbaa419b860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 >> 172.21.15.100:0/4165688679 conn(0x7fbaa4101e90 msgr2=0x7fbaa4102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 shutdown_connections 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:57:59.296+0000 7fbaac73f640 1 -- 172.21.15.100:0/4165688679 wait complete. 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 5 is available 2024-09-12T01:57:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:Setting orchestrator backend to cephadm... 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-mon[31179]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-mon[31179]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:00.305+0000 7f92d62b4640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:58:00] ENGINE Error in HTTPServer.serve 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: Traceback (most recent call last): 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self._connections.run(self.expiration_interval) 2024-09-12T01:58:00.532 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self._run(expiration_interval) 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: s = self.context.wrap_socket( 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: return self.sslsocket_class._create( 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self.do_handshake() 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:58:00.533 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self._sslobj.do_handshake() 2024-09-12T01:58:00.534 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:58:00.534 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:01.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.379+0000 7f3490adb640 1 Processor -- start 2024-09-12T01:58:01.210 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.379+0000 7f3490adb640 1 -- start start 2024-09-12T01:58:01.210 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.380+0000 7f3490adb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c107c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.210 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.380+0000 7f3490adb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f348c108240 con 0x7f348c107870 2024-09-12T01:58:01.210 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.380+0000 7f348a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.380+0000 7f348a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c107c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56530/0 (socket says 172.21.15.100:56530) 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.380+0000 7f348a59c640 1 -- 172.21.15.100:0/193228415 learned_addr learned my addr 172.21.15.100:0/193228415 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.380+0000 7f348a59c640 1 -- 172.21.15.100:0/193228415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c108a20 con 0x7f348c107870 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.381+0000 7f348a59c640 1 --2- 172.21.15.100:0/193228415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c107c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3484009e80 tx=0x7f348402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965725338d3c8124 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.381+0000 7f348959a640 1 -- 172.21.15.100:0/193228415 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3484036070 con 0x7f348c107870 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.381+0000 7f348959a640 1 -- 172.21.15.100:0/193228415 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34840318c0 con 0x7f348c107870 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.381+0000 7f348959a640 1 -- 172.21.15.100:0/193228415 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3484007ab0 con 0x7f348c107870 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.382+0000 7f3490adb640 1 -- 172.21.15.100:0/193228415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 msgr2=0x7f348c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.382+0000 7f3490adb640 1 --2- 172.21.15.100:0/193228415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c107c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3484009e80 tx=0x7f348402a7a0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.382+0000 7f3490adb640 1 -- 172.21.15.100:0/193228415 shutdown_connections 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.382+0000 7f3490adb640 1 --2- 172.21.15.100:0/193228415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c107c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.211 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.382+0000 7f3490adb640 1 -- 172.21.15.100:0/193228415 >> 172.21.15.100:0/193228415 conn(0x7f348c103080 msgr2=0x7f348c1054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.382+0000 7f3490adb640 1 -- 172.21.15.100:0/193228415 shutdown_connections 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.382+0000 7f3490adb640 1 -- 172.21.15.100:0/193228415 wait complete. 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.383+0000 7f3490adb640 1 Processor -- start 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.383+0000 7f3490adb640 1 -- start start 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.383+0000 7f3490adb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.383+0000 7f3490adb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f348c10bdd0 con 0x7f348c107870 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.383+0000 7f348a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.383+0000 7f348a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56544/0 (socket says 172.21.15.100:56544) 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.383+0000 7f348a59c640 1 -- 172.21.15.100:0/418407307 learned_addr learned my addr 172.21.15.100:0/418407307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.384+0000 7f348a59c640 1 -- 172.21.15.100:0/418407307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c19bde0 con 0x7f348c107870 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.384+0000 7f348a59c640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c19b8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3484007ce0 tx=0x7f3484031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.384+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3484036050 con 0x7f348c107870 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.384+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3484042070 con 0x7f348c107870 2024-09-12T01:58:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.384+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348403d8a0 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.384+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c19c070 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.384+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c19ed60 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.385+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f348403db50 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.385+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c107cf0 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.385+0000 7f34837fe640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f3478038eb0 0x7f347803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.385+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3484007e00 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.385+0000 7f3489d9b640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f3478038eb0 0x7f347803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.386+0000 7f3489d9b640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f3478038eb0 0x7f347803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f34740098c0 tx=0x7f3474006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.390+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3484007310 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.530+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3484046be0 con 0x7f348c107870 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.577+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f348c1042e0 con 0x7f3478038eb0 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.581+0000 7f34837fe640 1 -- 172.21.15.100:0/418407307 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f348c1042e0 con 0x7f3478038eb0 2024-09-12T01:58:01.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f3478038eb0 msgr2=0x7f347803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f3478038eb0 0x7f347803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f34740098c0 tx=0x7f3474006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 msgr2=0x7f348c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c19b8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3484007ce0 tx=0x7f3484031ca0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 shutdown_connections 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f3478038eb0 0x7f347803b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 --2- 172.21.15.100:0/418407307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f348c107870 0x7f348c19b8a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 >> 172.21.15.100:0/418407307 conn(0x7f348c103080 msgr2=0x7f348c103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 shutdown_connections 2024-09-12T01:58:01.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:00.584+0000 7f3490adb640 1 -- 172.21.15.100:0/418407307 wait complete. 2024-09-12T01:58:01.489 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:00] ENGINE Bus STARTING 2024-09-12T01:58:01.489 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:00] ENGINE Serving on https://172.21.15.100:7150 2024-09-12T01:58:01.489 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:00] ENGINE Error in HTTPServer.serve 2024-09-12T01:58:01.489 INFO:journalctl@ceph.mon.a.smithi100.stdout: Traceback (most recent call last): 2024-09-12T01:58:01.489 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:58:01.489 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:58:01.489 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._run(expiration_interval) 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: s = self.context.wrap_socket( 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: return self.sslsocket_class._create( 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: self.do_handshake() 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._sslobj.do_handshake() 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:00] ENGINE Serving on http://172.21.15.100:8765 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:00] ENGINE Bus STARTED 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: mgrmap e8: x(active, since 2s) 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:01.491 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:01 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:02.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T01:58:02.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.566+0000 7fb35338f640 1 Processor -- start 2024-09-12T01:58:02.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.567+0000 7fb35338f640 1 -- start start 2024-09-12T01:58:02.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.567+0000 7fb35338f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c107be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.567+0000 7fb35338f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c1081b0 con 0x7fb34c1077e0 2024-09-12T01:58:02.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.567+0000 7fb35112b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c107be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.567+0000 7fb35112b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c107be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56554/0 (socket says 172.21.15.100:56554) 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.567+0000 7fb35112b640 1 -- 172.21.15.100:0/667798195 learned_addr learned my addr 172.21.15.100:0/667798195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.567+0000 7fb35112b640 1 -- 172.21.15.100:0/667798195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c1089e0 con 0x7fb34c1077e0 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.568+0000 7fb35112b640 1 --2- 172.21.15.100:0/667798195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c107be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb340009820 tx=0x7fb34002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afe15bcd294289 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.568+0000 7fb33ffff640 1 -- 172.21.15.100:0/667798195 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340037070 con 0x7fb34c1077e0 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.568+0000 7fb33ffff640 1 -- 172.21.15.100:0/667798195 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb340032900 con 0x7fb34c1077e0 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.568+0000 7fb33ffff640 1 -- 172.21.15.100:0/667798195 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340030850 con 0x7fb34c1077e0 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.568+0000 7fb35338f640 1 -- 172.21.15.100:0/667798195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 msgr2=0x7fb34c107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.568+0000 7fb35338f640 1 --2- 172.21.15.100:0/667798195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c107be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb340009820 tx=0x7fb34002a270 comp rx=0 tx=0).stop 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 -- 172.21.15.100:0/667798195 shutdown_connections 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 --2- 172.21.15.100:0/667798195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c107be0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 -- 172.21.15.100:0/667798195 >> 172.21.15.100:0/667798195 conn(0x7fb34c102ff0 msgr2=0x7fb34c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 -- 172.21.15.100:0/667798195 shutdown_connections 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 -- 172.21.15.100:0/667798195 wait complete. 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 Processor -- start 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 -- start start 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.569+0000 7fb35338f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c10bd90 con 0x7fb34c1077e0 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb35112b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb35112b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56558/0 (socket says 172.21.15.100:56558) 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb35112b640 1 -- 172.21.15.100:0/1652730086 learned_addr learned my addr 172.21.15.100:0/1652730086 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:02.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb35112b640 1 -- 172.21.15.100:0/1652730086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c19bd40 con 0x7fb34c1077e0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb35112b640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c19b800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb340009940 tx=0x7fb340032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb33e7fc640 1 -- 172.21.15.100:0/1652730086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340042070 con 0x7fb34c1077e0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb33e7fc640 1 -- 172.21.15.100:0/1652730086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3400308c0 con 0x7fb34c1077e0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c19bfd0 con 0x7fb34c1077e0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb33e7fc640 1 -- 172.21.15.100:0/1652730086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340037040 con 0x7fb34c1077e0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.570+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c19ecc0 con 0x7fb34c1077e0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.571+0000 7fb33e7fc640 1 -- 172.21.15.100:0/1652730086 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb340045070 con 0x7fb34c1077e0 2024-09-12T01:58:02.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.571+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34c10bf10 con 0x7fb34c1077e0 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.571+0000 7fb33e7fc640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fb338038fc0 0x7fb33803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.571+0000 7fb33e7fc640 1 -- 172.21.15.100:0/1652730086 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb34006bff0 con 0x7fb34c1077e0 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.571+0000 7fb35092a640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fb338038fc0 0x7fb33803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.572+0000 7fb35092a640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fb338038fc0 0x7fb33803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3480098c0 tx=0x7fb348006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.576+0000 7fb33e7fc640 1 -- 172.21.15.100:0/1652730086 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb34004b170 con 0x7fb34c1077e0 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.748+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fb34c104280 con 0x7fb338038fc0 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.749+0000 7fb33e7fc640 1 -- 172.21.15.100:0/1652730086 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fb34c104280 con 0x7fb338038fc0 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.751+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fb338038fc0 msgr2=0x7fb33803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.751+0000 7fb35338f640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fb338038fc0 0x7fb33803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3480098c0 tx=0x7fb348006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.751+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 msgr2=0x7fb34c19b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.751+0000 7fb35338f640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c19b800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb340009940 tx=0x7fb340032ce0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.752+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 shutdown_connections 2024-09-12T01:58:02.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.752+0000 7fb35338f640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fb338038fc0 0x7fb33803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.752+0000 7fb35338f640 1 --2- 172.21.15.100:0/1652730086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb34c1077e0 0x7fb34c19b800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.752+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 >> 172.21.15.100:0/1652730086 conn(0x7fb34c102ff0 msgr2=0x7fb34c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.752+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 shutdown_connections 2024-09-12T01:58:02.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:01.752+0000 7fb35338f640 1 -- 172.21.15.100:0/1652730086 wait complete. 2024-09-12T01:58:02.315 INFO:teuthology.orchestra.run.smithi100.stdout:Generating ssh key... 2024-09-12T01:58:02.612 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:02 smithi100 ceph-mon[31179]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-mon[31179]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: Generating public/private rsa key pair. 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: Your identification has been saved in /tmp/tmp762f11tr/key 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: Your public key has been saved in /tmp/tmp762f11tr/key.pub 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: The key fingerprint is: 2024-09-12T01:58:03.490 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: SHA256:+c8fAlWIp/hYpA9Eppw2LP9sD35jjjkCK0Zz1fUJkF8 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: The key's randomart image is: 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: +---[RSA 3072]----+ 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | .+o . .. | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | o +o = E. | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | . Bo * *.. | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | +..=.+.o | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | .. S*. | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | o o o..o. | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | . o o = . . . | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | o . .o.=+o . . | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: | . . .+=o.o.. | 2024-09-12T01:58:03.491 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: +----[SHA256]-----+ 2024-09-12T01:58:03.789 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.686+0000 7f4826cc4640 1 Processor -- start 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.686+0000 7f4826cc4640 1 -- start start 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.686+0000 7f4826cc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f4820105ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.686+0000 7f4826cc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48201064b0 con 0x7f4820105ae0 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.686+0000 7f4824a60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f4820105ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.686+0000 7f4824a60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f4820105ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56574/0 (socket says 172.21.15.100:56574) 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.686+0000 7f4824a60640 1 -- 172.21.15.100:0/4259049473 learned_addr learned my addr 172.21.15.100:0/4259049473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.687+0000 7f4824a60640 1 -- 172.21.15.100:0/4259049473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4820108ac0 con 0x7f4820105ae0 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.687+0000 7f4824a60640 1 --2- 172.21.15.100:0/4259049473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f4820105ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4814009820 tx=0x7f481402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8319fd20324691 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.687+0000 7f481f7fe640 1 -- 172.21.15.100:0/4259049473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4814037070 con 0x7f4820105ae0 2024-09-12T01:58:03.790 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.687+0000 7f481f7fe640 1 -- 172.21.15.100:0/4259049473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4814032900 con 0x7f4820105ae0 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.687+0000 7f481f7fe640 1 -- 172.21.15.100:0/4259049473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4814030850 con 0x7f4820105ae0 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.688+0000 7f4826cc4640 1 -- 172.21.15.100:0/4259049473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 msgr2=0x7f4820105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.688+0000 7f4826cc4640 1 --2- 172.21.15.100:0/4259049473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f4820105ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4814009820 tx=0x7f481402a270 comp rx=0 tx=0).stop 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.688+0000 7f4826cc4640 1 -- 172.21.15.100:0/4259049473 shutdown_connections 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.688+0000 7f4826cc4640 1 --2- 172.21.15.100:0/4259049473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f4820105ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.688+0000 7f4826cc4640 1 -- 172.21.15.100:0/4259049473 >> 172.21.15.100:0/4259049473 conn(0x7f48201016b0 msgr2=0x7f4820103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.688+0000 7f4826cc4640 1 -- 172.21.15.100:0/4259049473 shutdown_connections 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.688+0000 7f4826cc4640 1 -- 172.21.15.100:0/4259049473 wait complete. 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4826cc4640 1 Processor -- start 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4826cc4640 1 -- start start 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4826cc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f482019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4826cc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f482010bcf0 con 0x7f4820105ae0 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4824a60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f482019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.791 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4824a60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f482019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56586/0 (socket says 172.21.15.100:56586) 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4824a60640 1 -- 172.21.15.100:0/2593493256 learned_addr learned my addr 172.21.15.100:0/2593493256 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4824a60640 1 -- 172.21.15.100:0/2593493256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482019bdb0 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4824a60640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f482019b870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4814009940 tx=0x7f48140326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f481dffb640 1 -- 172.21.15.100:0/2593493256 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4814042070 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f481dffb640 1 -- 172.21.15.100:0/2593493256 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4814032be0 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482019c040 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.689+0000 7f481dffb640 1 -- 172.21.15.100:0/2593493256 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4814037040 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.690+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f482019ed30 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.690+0000 7f481dffb640 1 -- 172.21.15.100:0/2593493256 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4814045070 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.691+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4820105f60 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.691+0000 7f481dffb640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f4810038f70 0x7f481003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.691+0000 7f481dffb640 1 -- 172.21.15.100:0/2593493256 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f481406c050 con 0x7f4820105ae0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.691+0000 7f481ffff640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f4810038f70 0x7f481003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.792 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.691+0000 7f481ffff640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f4810038f70 0x7f481003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f480c0098c0 tx=0x7f480c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.695+0000 7f481dffb640 1 -- 172.21.15.100:0/2593493256 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4814032e00 con 0x7f4820105ae0 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:02.860+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f4820102980 con 0x7f4810038f70 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.182+0000 7f481dffb640 1 -- 172.21.15.100:0/2593493256 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4820102980 con 0x7f4810038f70 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f4810038f70 msgr2=0x7f481003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f4810038f70 0x7f481003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f480c0098c0 tx=0x7f480c006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 msgr2=0x7f482019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f482019b870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4814009940 tx=0x7f48140326e0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 shutdown_connections 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f4810038f70 0x7f481003b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 --2- 172.21.15.100:0/2593493256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820105ae0 0x7f482019b870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.184+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 >> 172.21.15.100:0/2593493256 conn(0x7f48201016b0 msgr2=0x7f4820102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.185+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 shutdown_connections 2024-09-12T01:58:03.793 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:03.185+0000 7f4826cc4640 1 -- 172.21.15.100:0/2593493256 wait complete. 2024-09-12T01:58:04.688 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:04 smithi100 ceph-mon[31179]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:04.688 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:04 smithi100 ceph-mon[31179]: Generating ssh key... 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq+dFF7K22gBUAlxsZKPDBHWe4afISgBTpy/0CzQGVtxnkWXczDONhXMREUxyQtzqiyHfJY5p+48XL+aFOXxy9trTBG6jgdm64I+vF30GCI+/K8usLfHOOW6MNeGQJbBIibBOQ9gr6cPouqdsHN66wIKa5RnQ9IGY0UjQ/cq0Zu0fbGqpx7XqWk/unSQiE8CX1cS24hvvPYt232jDdwjANK+Y96PqVLv+L2HvwdUzd14Rid9YjRd7HJQ0lppJY0ZAG/NUOZA+GVayeJ4uVqqmEkq03pYqTHanIXP9fsVIafAiyvgTP3JJFS8pFIrHZJlBUoHe55I56mhaTfHnjxRLGEFbDhXRyl2BMXAUfw7/XG/B8X19P4Ta42rGYaVB8UeaYbVGuMh2J8q/UaozU+DFJ2zQNvoUs9n6Z9S4xqUuaulMCI/sfrsggl6WPQ/AecBzrgnQO7kfi7ghx7ucusirbApREM8YcyPQwvV4joVSYOW5LRGRWdOi1Z2ZFd4jMQk0= ceph-3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.160+0000 7f6d58955640 1 Processor -- start 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.160+0000 7f6d58955640 1 -- start start 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.161+0000 7f6d58955640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d54106ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.161+0000 7f6d58955640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54107080 con 0x7f6d541066b0 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.161+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d54106ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.161+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d54106ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59484/0 (socket says 172.21.15.100:59484) 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.161+0000 7f6d5259c640 1 -- 172.21.15.100:0/1706690872 learned_addr learned my addr 172.21.15.100:0/1706690872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.161+0000 7f6d5259c640 1 -- 172.21.15.100:0/1706690872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d541078b0 con 0x7f6d541066b0 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.162+0000 7f6d5259c640 1 --2- 172.21.15.100:0/1706690872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d54106ab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009820 tx=0x7f6d4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d179c483dcc5c184 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.963 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.162+0000 7f6d5159a640 1 -- 172.21.15.100:0/1706690872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d44037070 con 0x7f6d541066b0 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.162+0000 7f6d5159a640 1 -- 172.21.15.100:0/1706690872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d44032900 con 0x7f6d541066b0 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.162+0000 7f6d5159a640 1 -- 172.21.15.100:0/1706690872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d44030850 con 0x7f6d541066b0 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.162+0000 7f6d58955640 1 -- 172.21.15.100:0/1706690872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 msgr2=0x7f6d54106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.162+0000 7f6d58955640 1 --2- 172.21.15.100:0/1706690872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d54106ab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009820 tx=0x7f6d4402a270 comp rx=0 tx=0).stop 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.163+0000 7f6d58955640 1 -- 172.21.15.100:0/1706690872 shutdown_connections 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.163+0000 7f6d58955640 1 --2- 172.21.15.100:0/1706690872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d54106ab0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.163+0000 7f6d58955640 1 -- 172.21.15.100:0/1706690872 >> 172.21.15.100:0/1706690872 conn(0x7f6d54101e60 msgr2=0x7f6d54104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.163+0000 7f6d58955640 1 -- 172.21.15.100:0/1706690872 shutdown_connections 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.163+0000 7f6d58955640 1 -- 172.21.15.100:0/1706690872 wait complete. 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.163+0000 7f6d58955640 1 Processor -- start 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.163+0000 7f6d58955640 1 -- start start 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d58955640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d5419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d58955640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5410ac60 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d5419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d5419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59492/0 (socket says 172.21.15.100:59492) 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d5259c640 1 -- 172.21.15.100:0/1912983550 learned_addr learned my addr 172.21.15.100:0/1912983550 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d5259c640 1 -- 172.21.15.100:0/1912983550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5419bd80 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d5259c640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d5419b840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009940 tx=0x7f6d44032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d437fe640 1 -- 172.21.15.100:0/1912983550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d44042070 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d437fe640 1 -- 172.21.15.100:0/1912983550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d440308c0 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5419c010 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d437fe640 1 -- 172.21.15.100:0/1912983550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d44037040 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.164+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5419ed00 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.165+0000 7f6d437fe640 1 -- 172.21.15.100:0/1912983550 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6d44045070 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.165+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5410ade0 con 0x7f6d541066b0 2024-09-12T01:58:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.165+0000 7f6d437fe640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f6d3c038f70 0x7f6d3c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.165+0000 7f6d437fe640 1 -- 172.21.15.100:0/1912983550 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6d4406c260 con 0x7f6d541066b0 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.166+0000 7f6d51d9b640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f6d3c038f70 0x7f6d3c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.166+0000 7f6d51d9b640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f6d3c038f70 0x7f6d3c03b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098c0 tx=0x7f6d48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.170+0000 7f6d437fe640 1 -- 172.21.15.100:0/1912983550 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d44045520 con 0x7f6d541066b0 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.338+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6d540008d0 con 0x7f6d3c038f70 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.338+0000 7f6d437fe640 1 -- 172.21.15.100:0/1912983550 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f6d540008d0 con 0x7f6d3c038f70 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f6d3c038f70 msgr2=0x7f6d3c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f6d3c038f70 0x7f6d3c03b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098c0 tx=0x7f6d48006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 msgr2=0x7f6d5419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d5419b840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009940 tx=0x7f6d44032ce0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 shutdown_connections 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f6d3c038f70 0x7f6d3c03b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 --2- 172.21.15.100:0/1912983550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d541066b0 0x7f6d5419b840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 >> 172.21.15.100:0/1912983550 conn(0x7f6d54101e60 msgr2=0x7f6d54102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 shutdown_connections 2024-09-12T01:58:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:04.341+0000 7f6d58955640 1 -- 172.21.15.100:0/1912983550 wait complete. 2024-09-12T01:58:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:58:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T01:58:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:Adding host smithi100... 2024-09-12T01:58:05.563 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:05 smithi100 ceph-mon[31179]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:06.768 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:06 smithi100 ceph-mon[31179]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:06.768 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:06 smithi100 ceph-mon[31179]: Deploying cephadm binary to smithi100 2024-09-12T01:58:09.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Added host 'smithi100' with addr '172.21.15.100' 2024-09-12T01:58:09.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.384+0000 7f719e01a640 1 Processor -- start 2024-09-12T01:58:09.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.384+0000 7f719e01a640 1 -- start start 2024-09-12T01:58:09.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.384+0000 7f719e01a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f7198107c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:09.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.384+0000 7f719e01a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7198108200 con 0x7f7198107830 2024-09-12T01:58:09.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.384+0000 7f71977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f7198107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:09.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.385+0000 7f71977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f7198107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59496/0 (socket says 172.21.15.100:59496) 2024-09-12T01:58:09.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.385+0000 7f71977fe640 1 -- 172.21.15.100:0/38730447 learned_addr learned my addr 172.21.15.100:0/38730447 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:09.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.385+0000 7f71977fe640 1 -- 172.21.15.100:0/38730447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71981089e0 con 0x7f7198107830 2024-09-12T01:58:09.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.385+0000 7f71977fe640 1 --2- 172.21.15.100:0/38730447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f7198107c30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e80 tx=0x7f718802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997dec24ce3f9aaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f71967fc640 1 -- 172.21.15.100:0/38730447 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7188036070 con 0x7f7198107830 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f71967fc640 1 -- 172.21.15.100:0/38730447 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71880318c0 con 0x7f7198107830 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f71967fc640 1 -- 172.21.15.100:0/38730447 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7188007ab0 con 0x7f7198107830 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f719e01a640 1 -- 172.21.15.100:0/38730447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 msgr2=0x7f7198107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f719e01a640 1 --2- 172.21.15.100:0/38730447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f7198107c30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e80 tx=0x7f718802a7a0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f719e01a640 1 -- 172.21.15.100:0/38730447 shutdown_connections 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f719e01a640 1 --2- 172.21.15.100:0/38730447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f7198107c30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.305 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f719e01a640 1 -- 172.21.15.100:0/38730447 >> 172.21.15.100:0/38730447 conn(0x7f7198103040 msgr2=0x7f7198105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f719e01a640 1 -- 172.21.15.100:0/38730447 shutdown_connections 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.386+0000 7f719e01a640 1 -- 172.21.15.100:0/38730447 wait complete. 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.387+0000 7f719e01a640 1 Processor -- start 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.387+0000 7f719e01a640 1 -- start start 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.387+0000 7f719e01a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f719807db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.387+0000 7f719e01a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f719810bd90 con 0x7f7198107830 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.387+0000 7f71977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f719807db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.387+0000 7f71977fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f719807db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59504/0 (socket says 172.21.15.100:59504) 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.387+0000 7f71977fe640 1 -- 172.21.15.100:0/704674084 learned_addr learned my addr 172.21.15.100:0/704674084 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:09.306 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.388+0000 7f71977fe640 1 -- 172.21.15.100:0/704674084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719807e060 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.388+0000 7f71977fe640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f719807db20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f718802ad90 tx=0x7f7188031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.388+0000 7f7194ff9640 1 -- 172.21.15.100:0/704674084 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7188036050 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.388+0000 7f7194ff9640 1 -- 172.21.15.100:0/704674084 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7188042070 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.388+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719807c250 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.388+0000 7f7194ff9640 1 -- 172.21.15.100:0/704674084 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f718803d7e0 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.388+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719807c790 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.389+0000 7f7194ff9640 1 -- 172.21.15.100:0/704674084 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f718803da90 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.389+0000 7f7194ff9640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7180038fc0 0x7f718003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.389+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719810bf10 con 0x7f7198107830 2024-09-12T01:58:09.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.389+0000 7f7194ff9640 1 -- 172.21.15.100:0/704674084 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7188007e00 con 0x7f7198107830 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.389+0000 7f7196ffd640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7180038fc0 0x7f718003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.390+0000 7f7196ffd640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7180038fc0 0x7f718003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f718c0098c0 tx=0x7f718c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.394+0000 7f7194ff9640 1 -- 172.21.15.100:0/704674084 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7188045c60 con 0x7f7198107830 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:05.562+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}) -- 0x7f719807d020 con 0x7f7180038fc0 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.683+0000 7f7194ff9640 1 -- 172.21.15.100:0/704674084 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f719807d020 con 0x7f7180038fc0 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7180038fc0 msgr2=0x7f718003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7180038fc0 0x7f718003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f718c0098c0 tx=0x7f718c006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 msgr2=0x7f719807db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f719807db20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f718802ad90 tx=0x7f7188031ca0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 shutdown_connections 2024-09-12T01:58:09.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7180038fc0 0x7f718003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 --2- 172.21.15.100:0/704674084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7198107830 0x7f719807db20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 >> 172.21.15.100:0/704674084 conn(0x7f7198103040 msgr2=0x7f7198103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:09.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 shutdown_connections 2024-09-12T01:58:09.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:08.686+0000 7f719e01a640 1 -- 172.21.15.100:0/704674084 wait complete. 2024-09-12T01:58:09.309 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying unmanaged mon service... 2024-09-12T01:58:09.909 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:09 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:09.909 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:09 smithi100 ceph-mon[31179]: Added host smithi100 2024-09-12T01:58:09.909 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:09 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:10.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T01:58:10.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.695+0000 7f8d8738c640 1 Processor -- start 2024-09-12T01:58:10.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.696+0000 7f8d8738c640 1 -- start start 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.696+0000 7f8d8738c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.696+0000 7f8d8738c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8007c860 con 0x7f8d8007de30 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.696+0000 7f8d85128640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.696+0000 7f8d85128640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59508/0 (socket says 172.21.15.100:59508) 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.696+0000 7f8d85128640 1 -- 172.21.15.100:0/1288209117 learned_addr learned my addr 172.21.15.100:0/1288209117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.696+0000 7f8d85128640 1 -- 172.21.15.100:0/1288209117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8007c9e0 con 0x7f8d8007de30 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.697+0000 7f8d85128640 1 --2- 172.21.15.100:0/1288209117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8007c290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009820 tx=0x7f8d7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d05e73da930cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.697+0000 7f8d73fff640 1 -- 172.21.15.100:0/1288209117 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c037070 con 0x7f8d8007de30 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.697+0000 7f8d73fff640 1 -- 172.21.15.100:0/1288209117 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d7c032900 con 0x7f8d8007de30 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.697+0000 7f8d73fff640 1 -- 172.21.15.100:0/1288209117 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c030850 con 0x7f8d8007de30 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 -- 172.21.15.100:0/1288209117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 msgr2=0x7f8d8007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 --2- 172.21.15.100:0/1288209117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8007c290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009820 tx=0x7f8d7c02a270 comp rx=0 tx=0).stop 2024-09-12T01:58:10.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 -- 172.21.15.100:0/1288209117 shutdown_connections 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 --2- 172.21.15.100:0/1288209117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8007c290 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 -- 172.21.15.100:0/1288209117 >> 172.21.15.100:0/1288209117 conn(0x7f8d80102ff0 msgr2=0x7f8d80105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 -- 172.21.15.100:0/1288209117 shutdown_connections 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 -- 172.21.15.100:0/1288209117 wait complete. 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.698+0000 7f8d8738c640 1 Processor -- start 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d8738c640 1 -- start start 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d8738c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8019da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d8738c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8010de30 con 0x7f8d8007de30 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d85128640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8019da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d85128640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8019da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59514/0 (socket says 172.21.15.100:59514) 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d85128640 1 -- 172.21.15.100:0/2469088513 learned_addr learned my addr 172.21.15.100:0/2469088513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d85128640 1 -- 172.21.15.100:0/2469088513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8019df80 con 0x7f8d8007de30 2024-09-12T01:58:10.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d85128640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8019da40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c031000 tx=0x7f8d7c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d727fc640 1 -- 172.21.15.100:0/2469088513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c042070 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d727fc640 1 -- 172.21.15.100:0/2469088513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d7c032be0 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8019e210 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d727fc640 1 -- 172.21.15.100:0/2469088513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c037040 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.699+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d801a0f00 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.700+0000 7f8d727fc640 1 -- 172.21.15.100:0/2469088513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8d7c045070 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.700+0000 7f8d727fc640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f8d6c038fc0 0x7f8d6c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.700+0000 7f8d727fc640 1 -- 172.21.15.100:0/2469088513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8d7c06bf90 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.701+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8007c310 con 0x7f8d8007de30 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.701+0000 7f8d84927640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f8d6c038fc0 0x7f8d6c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.701+0000 7f8d84927640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f8d6c038fc0 0x7f8d6c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d740098c0 tx=0x7f8d74006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:10.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.705+0000 7f8d727fc640 1 -- 172.21.15.100:0/2469088513 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d7c045360 con 0x7f8d8007de30 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.909+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8d801042f0 con 0x7f8d6c038fc0 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.914+0000 7f8d727fc640 1 -- 172.21.15.100:0/2469088513 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8d801042f0 con 0x7f8d6c038fc0 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f8d6c038fc0 msgr2=0x7f8d6c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f8d6c038fc0 0x7f8d6c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d740098c0 tx=0x7f8d74006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 msgr2=0x7f8d8019da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8019da40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c031000 tx=0x7f8d7c0326e0 comp rx=0 tx=0).stop 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 shutdown_connections 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f8d6c038fc0 0x7f8d6c03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 --2- 172.21.15.100:0/2469088513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d8007de30 0x7f8d8019da40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.916+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 >> 172.21.15.100:0/2469088513 conn(0x7f8d80102ff0 msgr2=0x7f8d80103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.917+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 shutdown_connections 2024-09-12T01:58:10.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:09.917+0000 7f8d8738c640 1 -- 172.21.15.100:0/2469088513 wait complete. 2024-09-12T01:58:10.725 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying unmanaged mgr service... 2024-09-12T01:58:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:10 smithi100 ceph-mon[31179]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:10 smithi100 ceph-mon[31179]: Saving service mon spec with placement count:5 2024-09-12T01:58:11.025 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:10 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:12.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:12 smithi100 ceph-mon[31179]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:12.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:12 smithi100 ceph-mon[31179]: Saving service mgr spec with placement count:2 2024-09-12T01:58:12.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:12 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:12.694 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T01:58:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.103+0000 7efe9aa0c640 1 Processor -- start 2024-09-12T01:58:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.103+0000 7efe9aa0c640 1 -- start start 2024-09-12T01:58:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.103+0000 7efe9aa0c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe94107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.695 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.103+0000 7efe9aa0c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efe941081d0 con 0x7efe94107800 2024-09-12T01:58:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.103+0000 7efe93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe94107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.104+0000 7efe93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe94107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59518/0 (socket says 172.21.15.100:59518) 2024-09-12T01:58:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.104+0000 7efe93fff640 1 -- 172.21.15.100:0/1447365257 learned_addr learned my addr 172.21.15.100:0/1447365257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.104+0000 7efe93fff640 1 -- 172.21.15.100:0/1447365257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe94108a00 con 0x7efe94107800 2024-09-12T01:58:12.696 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.104+0000 7efe93fff640 1 --2- 172.21.15.100:0/1447365257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe94107c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe84009820 tx=0x7efe8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7f1d379cb5f160 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe92ffd640 1 -- 172.21.15.100:0/1447365257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe84037070 con 0x7efe94107800 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe92ffd640 1 -- 172.21.15.100:0/1447365257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe84032900 con 0x7efe94107800 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe92ffd640 1 -- 172.21.15.100:0/1447365257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe84030850 con 0x7efe94107800 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe9aa0c640 1 -- 172.21.15.100:0/1447365257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 msgr2=0x7efe94107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe9aa0c640 1 --2- 172.21.15.100:0/1447365257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe94107c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe84009820 tx=0x7efe8402a270 comp rx=0 tx=0).stop 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe9aa0c640 1 -- 172.21.15.100:0/1447365257 shutdown_connections 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe9aa0c640 1 --2- 172.21.15.100:0/1447365257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe94107c00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe9aa0c640 1 -- 172.21.15.100:0/1447365257 >> 172.21.15.100:0/1447365257 conn(0x7efe94102ff0 msgr2=0x7efe94105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe9aa0c640 1 -- 172.21.15.100:0/1447365257 shutdown_connections 2024-09-12T01:58:12.697 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.105+0000 7efe9aa0c640 1 -- 172.21.15.100:0/1447365257 wait complete. 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.106+0000 7efe9aa0c640 1 Processor -- start 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.106+0000 7efe9aa0c640 1 -- start start 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.106+0000 7efe9aa0c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe9419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.106+0000 7efe9aa0c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efe9410bdb0 con 0x7efe94107800 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.106+0000 7efe93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe9419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.106+0000 7efe93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe9419b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59528/0 (socket says 172.21.15.100:59528) 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.106+0000 7efe93fff640 1 -- 172.21.15.100:0/3802995041 learned_addr learned my addr 172.21.15.100:0/3802995041 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.107+0000 7efe93fff640 1 -- 172.21.15.100:0/3802995041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9419be30 con 0x7efe94107800 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.107+0000 7efe93fff640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe9419b8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe84009940 tx=0x7efe840326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.107+0000 7efe917fa640 1 -- 172.21.15.100:0/3802995041 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe84042070 con 0x7efe94107800 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.107+0000 7efe917fa640 1 -- 172.21.15.100:0/3802995041 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe84032be0 con 0x7efe94107800 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.107+0000 7efe917fa640 1 -- 172.21.15.100:0/3802995041 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe84037040 con 0x7efe94107800 2024-09-12T01:58:12.698 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.107+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9419c0c0 con 0x7efe94107800 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.107+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9419edb0 con 0x7efe94107800 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.108+0000 7efe917fa640 1 -- 172.21.15.100:0/3802995041 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7efe84045070 con 0x7efe94107800 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.108+0000 7efe917fa640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7efe7c038f70 0x7efe7c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.108+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9410bf30 con 0x7efe94107800 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.108+0000 7efe917fa640 1 -- 172.21.15.100:0/3802995041 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efe8406bef0 con 0x7efe94107800 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.108+0000 7efe937fe640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7efe7c038f70 0x7efe7c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.108+0000 7efe937fe640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7efe7c038f70 0x7efe7c03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efe880098c0 tx=0x7efe88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.113+0000 7efe917fa640 1 -- 172.21.15.100:0/3802995041 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe8404b170 con 0x7efe94107800 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.294+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7efe94104300 con 0x7efe7c038f70 2024-09-12T01:58:12.699 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.299+0000 7efe917fa640 1 -- 172.21.15.100:0/3802995041 <== mgr.14118 v2:172.21.15.100:6800/824408405 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efe94104300 con 0x7efe7c038f70 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7efe7c038f70 msgr2=0x7efe7c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7efe7c038f70 0x7efe7c03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efe880098c0 tx=0x7efe88006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 msgr2=0x7efe9419b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe9419b8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe84009940 tx=0x7efe840326e0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 shutdown_connections 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7efe7c038f70 0x7efe7c03b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 --2- 172.21.15.100:0/3802995041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94107800 0x7efe9419b8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.700 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 >> 172.21.15.100:0/3802995041 conn(0x7efe94102ff0 msgr2=0x7efe94103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.701 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 shutdown_connections 2024-09-12T01:58:12.701 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:11.301+0000 7efe9aa0c640 1 -- 172.21.15.100:0/3802995041 wait complete. 2024-09-12T01:58:13.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.146+0000 7f7381374640 1 Processor -- start 2024-09-12T01:58:13.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.146+0000 7f7381374640 1 -- start start 2024-09-12T01:58:13.925 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.146+0000 7f7381374640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.146+0000 7f7381374640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f737c1081d0 con 0x7f737c107800 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.147+0000 7f737affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.147+0000 7f737affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59540/0 (socket says 172.21.15.100:59540) 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.147+0000 7f737affd640 1 -- 172.21.15.100:0/4199499171 learned_addr learned my addr 172.21.15.100:0/4199499171 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.147+0000 7f737affd640 1 -- 172.21.15.100:0/4199499171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c108a00 con 0x7f737c107800 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.148+0000 7f737affd640 1 --2- 172.21.15.100:0/4199499171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c107c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f736c009e80 tx=0x7f736c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702276b08cb45bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.148+0000 7f7379ffb640 1 -- 172.21.15.100:0/4199499171 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f736c036070 con 0x7f737c107800 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.148+0000 7f7379ffb640 1 -- 172.21.15.100:0/4199499171 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f736c0318c0 con 0x7f737c107800 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.148+0000 7f7379ffb640 1 -- 172.21.15.100:0/4199499171 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f736c007ab0 con 0x7f737c107800 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.148+0000 7f7381374640 1 -- 172.21.15.100:0/4199499171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 msgr2=0x7f737c107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.148+0000 7f7381374640 1 --2- 172.21.15.100:0/4199499171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c107c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f736c009e80 tx=0x7f736c02a7a0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.926 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.149+0000 7f7381374640 1 -- 172.21.15.100:0/4199499171 shutdown_connections 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.149+0000 7f7381374640 1 --2- 172.21.15.100:0/4199499171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c107c00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.149+0000 7f7381374640 1 -- 172.21.15.100:0/4199499171 >> 172.21.15.100:0/4199499171 conn(0x7f737c102ff0 msgr2=0x7f737c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.149+0000 7f7381374640 1 -- 172.21.15.100:0/4199499171 shutdown_connections 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.149+0000 7f7381374640 1 -- 172.21.15.100:0/4199499171 wait complete. 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.149+0000 7f7381374640 1 Processor -- start 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f7381374640 1 -- start start 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f7381374640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f7381374640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f737c10bdb0 con 0x7f737c107800 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f737affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f737affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59548/0 (socket says 172.21.15.100:59548) 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f737affd640 1 -- 172.21.15.100:0/153641265 learned_addr learned my addr 172.21.15.100:0/153641265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:13.927 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f737affd640 1 -- 172.21.15.100:0/153641265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c19bdd0 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f737affd640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c19b890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f736c007ce0 tx=0x7f736c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f736c036050 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c19c060 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f736c042070 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.150+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f736c03d8a0 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.151+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c19ed50 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.151+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f736c03dba0 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.152+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c10bf30 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.152+0000 7f7363fff640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7364038f70 0x7f736403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.152+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f736c007e00 con 0x7f737c107800 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.152+0000 7f737a7fc640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7364038f70 0x7f736403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.152+0000 7f737a7fc640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7364038f70 0x7f736403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f73700098c0 tx=0x7f7370006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.157+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f736c044310 con 0x7f737c107800 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.278+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f736c037040 con 0x7f737c107800 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.330+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f737c107c80 con 0x7f737c107800 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.335+0000 7f7363fff640 1 -- 172.21.15.100:0/153641265 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f736c007310 con 0x7f737c107800 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7364038f70 msgr2=0x7f736403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7364038f70 0x7f736403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f73700098c0 tx=0x7f7370006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 msgr2=0x7f737c19b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c19b890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f736c007ce0 tx=0x7f736c031ca0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 shutdown_connections 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f7364038f70 0x7f736403b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 --2- 172.21.15.100:0/153641265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c107800 0x7f737c19b890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 >> 172.21.15.100:0/153641265 conn(0x7f737c102ff0 msgr2=0x7f737c103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:13.929 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 shutdown_connections 2024-09-12T01:58:13.930 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:13.338+0000 7f7381374640 1 -- 172.21.15.100:0/153641265 wait complete. 2024-09-12T01:58:14.513 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:14 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:14.513 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:14 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/153641265' entity='client.admin' 2024-09-12T01:58:14.513 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:14 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:15.653 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:15 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3132347454' entity='client.admin' 2024-09-12T01:58:15.653 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:15 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54c51fb640 1 Processor -- start 2024-09-12T01:58:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54c51fb640 1 -- start start 2024-09-12T01:58:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54c51fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c007c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54c51fb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54c007c8a0 con 0x7f54c007de20 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c007c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c007c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43478/0 (socket says 172.21.15.100:43478) 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54bed9d640 1 -- 172.21.15.100:0/1218829721 learned_addr learned my addr 172.21.15.100:0/1218829721 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.327+0000 7f54bed9d640 1 -- 172.21.15.100:0/1218829721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c007ca20 con 0x7f54c007de20 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.328+0000 7f54bed9d640 1 --2- 172.21.15.100:0/1218829721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c007c2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009820 tx=0x7f54b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87692c46f61177f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.328+0000 7f54bdd9b640 1 -- 172.21.15.100:0/1218829721 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b0037070 con 0x7f54c007de20 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.328+0000 7f54bdd9b640 1 -- 172.21.15.100:0/1218829721 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b0032920 con 0x7f54c007de20 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.328+0000 7f54bdd9b640 1 -- 172.21.15.100:0/1218829721 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b0030810 con 0x7f54c007de20 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.329+0000 7f54c51fb640 1 -- 172.21.15.100:0/1218829721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 msgr2=0x7f54c007c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.329+0000 7f54c51fb640 1 --2- 172.21.15.100:0/1218829721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c007c2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009820 tx=0x7f54b002a270 comp rx=0 tx=0).stop 2024-09-12T01:58:15.661 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.329+0000 7f54c51fb640 1 -- 172.21.15.100:0/1218829721 shutdown_connections 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.329+0000 7f54c51fb640 1 --2- 172.21.15.100:0/1218829721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c007c2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.329+0000 7f54c51fb640 1 -- 172.21.15.100:0/1218829721 >> 172.21.15.100:0/1218829721 conn(0x7f54c0103040 msgr2=0x7f54c0105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.329+0000 7f54c51fb640 1 -- 172.21.15.100:0/1218829721 shutdown_connections 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.329+0000 7f54c51fb640 1 -- 172.21.15.100:0/1218829721 wait complete. 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54c51fb640 1 Processor -- start 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54c51fb640 1 -- start start 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54c51fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54c51fb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54c010de80 con 0x7f54c007de20 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54bed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c019d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43490/0 (socket says 172.21.15.100:43490) 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54bed9d640 1 -- 172.21.15.100:0/3132347454 learned_addr learned my addr 172.21.15.100:0/3132347454 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.330+0000 7f54bed9d640 1 -- 172.21.15.100:0/3132347454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c019df30 con 0x7f54c007de20 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.331+0000 7f54bed9d640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c019d9f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f54b0030380 tx=0x7f54b0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.662 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.331+0000 7f54a7fff640 1 -- 172.21.15.100:0/3132347454 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b0037040 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.331+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c019e1c0 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.331+0000 7f54a7fff640 1 -- 172.21.15.100:0/3132347454 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b0040070 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.331+0000 7f54a7fff640 1 -- 172.21.15.100:0/3132347454 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b003a7b0 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.331+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c01a0eb0 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.332+0000 7f54a7fff640 1 -- 172.21.15.100:0/3132347454 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f54b003aa30 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.332+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c007c350 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.332+0000 7f54a7fff640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f54a8038f70 0x7f54a803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.332+0000 7f54a7fff640 1 -- 172.21.15.100:0/3132347454 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f54b006c680 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.332+0000 7f54be59c640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f54a8038f70 0x7f54a803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.332+0000 7f54be59c640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f54a8038f70 0x7f54a803b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54b40098c0 tx=0x7f54b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.337+0000 7f54a7fff640 1 -- 172.21.15.100:0/3132347454 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54b0044c70 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.513+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f54c01a1080 con 0x7f54c007de20 2024-09-12T01:58:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.517+0000 7f54a7fff640 1 -- 172.21.15.100:0/3132347454 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f54b0041270 con 0x7f54c007de20 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f54a8038f70 msgr2=0x7f54a803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f54a8038f70 0x7f54a803b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54b40098c0 tx=0x7f54b4006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 msgr2=0x7f54c019d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c019d9f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f54b0030380 tx=0x7f54b0032670 comp rx=0 tx=0).stop 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 shutdown_connections 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f54a8038f70 0x7f54a803b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 --2- 172.21.15.100:0/3132347454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c007de20 0x7f54c019d9f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 >> 172.21.15.100:0/3132347454 conn(0x7f54c0103040 msgr2=0x7f54c0103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 shutdown_connections 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:14.519+0000 7f54c51fb640 1 -- 172.21.15.100:0/3132347454 wait complete. 2024-09-12T01:58:15.664 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling the dashboard module... 2024-09-12T01:58:17.447 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-mon[31179]: from='mgr.14118 172.21.15.100:0/2543306263' entity='mgr.x' 2024-09-12T01:58:17.447 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1034218383' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T01:58:17.447 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: ignoring --setuser ceph since I am not root 2024-09-12T01:58:17.447 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: ignoring --setgroup ceph since I am not root 2024-09-12T01:58:17.447 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:17.245+0000 7f9155aa5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:58:17.447 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:17.301+0000 7f9155aa5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:58:17.447 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:17.447+0000 7f9155aa5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:58:17.758 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:17.513+0000 7f9155aa5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:58:17.758 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:17.662+0000 7f9155aa5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:58:18.059 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:17 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:17.804+0000 7f9155aa5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:58:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.037+0000 7fab04e1c640 1 Processor -- start 2024-09-12T01:58:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.037+0000 7fab04e1c640 1 -- start start 2024-09-12T01:58:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.037+0000 7fab04e1c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00106b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.037+0000 7fab04e1c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab00107120 con 0x7fab00106750 2024-09-12T01:58:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.038+0000 7faafe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.038+0000 7faafe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43496/0 (socket says 172.21.15.100:43496) 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.038+0000 7faafe59c640 1 -- 172.21.15.100:0/1355392876 learned_addr learned my addr 172.21.15.100:0/1355392876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.038+0000 7faafe59c640 1 -- 172.21.15.100:0/1355392876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab00107950 con 0x7fab00106750 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.039+0000 7faafe59c640 1 --2- 172.21.15.100:0/1355392876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00106b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faae8009820 tx=0x7faae802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378214da1c465140 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.039+0000 7faafd59a640 1 -- 172.21.15.100:0/1355392876 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faae8037070 con 0x7fab00106750 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.039+0000 7faafd59a640 1 -- 172.21.15.100:0/1355392876 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faae8032920 con 0x7fab00106750 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.039+0000 7faafd59a640 1 -- 172.21.15.100:0/1355392876 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faae8030810 con 0x7fab00106750 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.040+0000 7fab04e1c640 1 -- 172.21.15.100:0/1355392876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 msgr2=0x7fab00106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.040+0000 7fab04e1c640 1 --2- 172.21.15.100:0/1355392876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00106b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faae8009820 tx=0x7faae802a270 comp rx=0 tx=0).stop 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.040+0000 7fab04e1c640 1 -- 172.21.15.100:0/1355392876 shutdown_connections 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.040+0000 7fab04e1c640 1 --2- 172.21.15.100:0/1355392876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00106b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.040+0000 7fab04e1c640 1 -- 172.21.15.100:0/1355392876 >> 172.21.15.100:0/1355392876 conn(0x7fab00101f20 msgr2=0x7fab00104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.040+0000 7fab04e1c640 1 -- 172.21.15.100:0/1355392876 shutdown_connections 2024-09-12T01:58:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.040+0000 7fab04e1c640 1 -- 172.21.15.100:0/1355392876 wait complete. 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7fab04e1c640 1 Processor -- start 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7fab04e1c640 1 -- start start 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7fab04e1c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00191910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7fab04e1c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010ad00 con 0x7fab00106750 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7faafe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00191910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7faafe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00191910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43506/0 (socket says 172.21.15.100:43506) 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7faafe59c640 1 -- 172.21.15.100:0/1034218383 learned_addr learned my addr 172.21.15.100:0/1034218383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.041+0000 7faafe59c640 1 -- 172.21.15.100:0/1034218383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab00191e50 con 0x7fab00106750 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.042+0000 7faafe59c640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00191910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faae80097f0 tx=0x7faae80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.042+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faae8037040 con 0x7fab00106750 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.042+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab00190040 con 0x7fab00106750 2024-09-12T01:58:18.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.042+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faae8030c40 con 0x7fab00106750 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.042+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faae803a5b0 con 0x7fab00106750 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.042+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab00190580 con 0x7fab00106750 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.043+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7faae803a7c0 con 0x7fab00106750 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.043+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab00106bd0 con 0x7fab00106750 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.043+0000 7faaf77fe640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7faaec039020 0x7faaec03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.043+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faae8030df0 con 0x7fab00106750 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.044+0000 7faafdd9b640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7faaec039020 0x7faaec03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.044+0000 7faafdd9b640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7faaec039020 0x7faaec03b4e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009910 tx=0x7faaf0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.048+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faae802fd60 con 0x7fab00106750 2024-09-12T01:58:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:16.266+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fab00195660 con 0x7fab00106750 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.092+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7faae8044920 con 0x7fab00106750 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.094+0000 7faaf77fe640 1 -- 172.21.15.100:0/1034218383 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7faae8044400 con 0x7fab00106750 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7faaec039020 msgr2=0x7faaec03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7faaec039020 0x7faaec03b4e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009910 tx=0x7faaf0006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 msgr2=0x7fab00191910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00191910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faae80097f0 tx=0x7faae80327b0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 shutdown_connections 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7faaec039020 0x7faaec03b4e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 --2- 172.21.15.100:0/1034218383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab00106750 0x7fab00191910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 >> 172.21.15.100:0/1034218383 conn(0x7fab00101f20 msgr2=0x7fab00102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 shutdown_connections 2024-09-12T01:58:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:17.096+0000 7fab04e1c640 1 -- 172.21.15.100:0/1034218383 wait complete. 2024-09-12T01:58:18.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:18 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1034218383' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T01:58:18.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:18 smithi100 ceph-mon[31179]: mgrmap e9: x(active, since 18s) 2024-09-12T01:58:18.317 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:18 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:18.121+0000 7f9155aa5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:58:18.318 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:18 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:18.181+0000 7f9155aa5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:58:18.568 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:18 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:18.370+0000 7f9155aa5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc428c9640 1 Processor -- start 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc428c9640 1 -- start start 2024-09-12T01:58:19.332 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc428c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c108420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc428c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c07be60 con 0x7fbc3c106010 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43544/0 (socket says 172.21.15.100:43544) 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc3bfff640 1 -- 172.21.15.100:0/758800691 learned_addr learned my addr 172.21.15.100:0/758800691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.508+0000 7fbc3bfff640 1 -- 172.21.15.100:0/758800691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c108960 con 0x7fbc3c106010 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.509+0000 7fbc3bfff640 1 --2- 172.21.15.100:0/758800691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c108420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009820 tx=0x7fbc2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7b6f3d3b9b0e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.509+0000 7fbc3b7fe640 1 -- 172.21.15.100:0/758800691 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2c037070 con 0x7fbc3c106010 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.509+0000 7fbc3b7fe640 1 -- 172.21.15.100:0/758800691 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc2c032920 con 0x7fbc3c106010 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.509+0000 7fbc3b7fe640 1 -- 172.21.15.100:0/758800691 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2c030810 con 0x7fbc3c106010 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.510+0000 7fbc428c9640 1 -- 172.21.15.100:0/758800691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 msgr2=0x7fbc3c108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.333 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.510+0000 7fbc428c9640 1 --2- 172.21.15.100:0/758800691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c108420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009820 tx=0x7fbc2c02a270 comp rx=0 tx=0).stop 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.510+0000 7fbc428c9640 1 -- 172.21.15.100:0/758800691 shutdown_connections 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.510+0000 7fbc428c9640 1 --2- 172.21.15.100:0/758800691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c108420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.510+0000 7fbc428c9640 1 -- 172.21.15.100:0/758800691 >> 172.21.15.100:0/758800691 conn(0x7fbc3c101e60 msgr2=0x7fbc3c104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.510+0000 7fbc428c9640 1 -- 172.21.15.100:0/758800691 shutdown_connections 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.510+0000 7fbc428c9640 1 -- 172.21.15.100:0/758800691 wait complete. 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.511+0000 7fbc428c9640 1 Processor -- start 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.511+0000 7fbc428c9640 1 -- start start 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.511+0000 7fbc428c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c1a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.511+0000 7fbc428c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c109aa0 con 0x7fbc3c106010 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c1a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c1a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43558/0 (socket says 172.21.15.100:43558) 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc3bfff640 1 -- 172.21.15.100:0/2825297340 learned_addr learned my addr 172.21.15.100:0/2825297340 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:19.334 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc3bfff640 1 -- 172.21.15.100:0/2825297340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c1a2310 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc3bfff640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c1a1dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c030380 tx=0x7fbc2c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc39ffb640 1 -- 172.21.15.100:0/2825297340 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2c037040 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc39ffb640 1 -- 172.21.15.100:0/2825297340 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc2c040070 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c1a25a0 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc39ffb640 1 -- 172.21.15.100:0/2825297340 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2c03a7b0 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.512+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c1a5290 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.513+0000 7fbc39ffb640 1 -- 172.21.15.100:0/2825297340 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fbc2c03a9e0 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.513+0000 7fbc39ffb640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 0x7fbc2803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.514+0000 7fbc39ffb640 1 -- 172.21.15.100:0/2825297340 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbc2c06c630 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.514+0000 7fbc33fff640 1 -- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 msgr2=0x7fbc2803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/824408405 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.514+0000 7fbc33fff640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 0x7fbc2803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.514+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc3c106410 con 0x7fbc3c106010 2024-09-12T01:58:19.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.519+0000 7fbc39ffb640 1 -- 172.21.15.100:0/2825297340 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc2c044c70 con 0x7fbc3c106010 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.715+0000 7fbc33fff640 1 -- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 msgr2=0x7fbc2803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/824408405 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.715+0000 7fbc33fff640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 0x7fbc2803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.737+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fbc3c19b260 con 0x7fbc3c106010 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.738+0000 7fbc39ffb640 1 -- 172.21.15.100:0/2825297340 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fbc2c041270 con 0x7fbc3c106010 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 msgr2=0x7fbc2803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 0x7fbc2803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 msgr2=0x7fbc3c1a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c1a1dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c030380 tx=0x7fbc2c032670 comp rx=0 tx=0).stop 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 shutdown_connections 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7fbc28039020 0x7fbc2803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 --2- 172.21.15.100:0/2825297340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc3c106010 0x7fbc3c1a1dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 >> 172.21.15.100:0/2825297340 conn(0x7fbc3c101e60 msgr2=0x7fbc3c104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:19.336 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 shutdown_connections 2024-09-12T01:58:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:18.742+0000 7fbc428c9640 1 -- 172.21.15.100:0/2825297340 wait complete. 2024-09-12T01:58:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-09-12T01:58:19.337 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 9... 2024-09-12T01:58:19.356 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:19 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2825297340' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:58:19.356 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:19 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:19.285+0000 7f9155aa5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:58:19.356 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:19 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:19.356+0000 7f9155aa5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:58:20.191 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.077+0000 7f9155aa5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:58:20.191 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.190+0000 7f9155aa5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:58:20.540 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.331+0000 7f9155aa5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:58:20.540 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.392+0000 7f9155aa5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:58:20.541 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.540+0000 7f9155aa5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:58:20.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.607+0000 7f9155aa5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:58:20.818 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.666+0000 7f9155aa5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:58:21.093 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.824+0000 7f9155aa5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:58:21.094 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.888+0000 7f9155aa5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:58:21.094 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:20.954+0000 7f9155aa5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:58:21.094 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:21.034+0000 7f9155aa5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:58:21.094 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:21.093+0000 7f9155aa5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:58:21.568 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:21.152+0000 7f9155aa5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:58:22.318 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:21.935+0000 7f9155aa5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: Active manager daemon x restarted 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: Activating manager daemon x 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: mgrmap e10: x(active, starting, since 0.00339054s) 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: Manager daemon x is now available 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:58:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.722+0000 7f8256113640 1 Processor -- start 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.722+0000 7f8256113640 1 -- start start 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.722+0000 7f8256113640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f8250106ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.602 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.722+0000 7f8256113640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8250107080 con 0x7f82501066b0 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.723+0000 7f824f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f8250106ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.723+0000 7f824f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f8250106ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43574/0 (socket says 172.21.15.100:43574) 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.723+0000 7f824f7fe640 1 -- 172.21.15.100:0/453332244 learned_addr learned my addr 172.21.15.100:0/453332244 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.723+0000 7f824f7fe640 1 -- 172.21.15.100:0/453332244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82501078b0 con 0x7f82501066b0 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.724+0000 7f824f7fe640 1 --2- 172.21.15.100:0/453332244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f8250106ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8240009820 tx=0x7f824002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87125b33703915d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.724+0000 7f824effd640 1 -- 172.21.15.100:0/453332244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8240037070 con 0x7f82501066b0 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.724+0000 7f824effd640 1 -- 172.21.15.100:0/453332244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8240032920 con 0x7f82501066b0 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.724+0000 7f824effd640 1 -- 172.21.15.100:0/453332244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8240030810 con 0x7f82501066b0 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 -- 172.21.15.100:0/453332244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 msgr2=0x7f8250106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 --2- 172.21.15.100:0/453332244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f8250106ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8240009820 tx=0x7f824002a270 comp rx=0 tx=0).stop 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 -- 172.21.15.100:0/453332244 shutdown_connections 2024-09-12T01:58:23.603 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 --2- 172.21.15.100:0/453332244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f8250106ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 -- 172.21.15.100:0/453332244 >> 172.21.15.100:0/453332244 conn(0x7f8250101e80 msgr2=0x7f82501042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 -- 172.21.15.100:0/453332244 shutdown_connections 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 -- 172.21.15.100:0/453332244 wait complete. 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.725+0000 7f8256113640 1 Processor -- start 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f8256113640 1 -- start start 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f8256113640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f825007ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f8256113640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f825010ac60 con 0x7f82501066b0 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f824f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f825007ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f824f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f825007ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43578/0 (socket says 172.21.15.100:43578) 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f824f7fe640 1 -- 172.21.15.100:0/1049195067 learned_addr learned my addr 172.21.15.100:0/1049195067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f824f7fe640 1 -- 172.21.15.100:0/1049195067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825019e590 con 0x7f82501066b0 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f824f7fe640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f825007ba00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8240030560 tx=0x7f8240032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:23.604 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.726+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8240037040 con 0x7f82501066b0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.727+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8240040070 con 0x7f82501066b0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.727+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825019e760 con 0x7f82501066b0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.727+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f824003a6d0 con 0x7f82501066b0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.727+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825019eb00 con 0x7f82501066b0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.727+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f824003a940 con 0x7f82501066b0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.728+0000 7f824d7fa640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 0x7f823c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.728+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 --> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8250106b30 con 0x7f823c038fc0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.728+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f824006c5c0 con 0x7f82501066b0 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.728+0000 7f8247fff640 1 -- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 msgr2=0x7f823c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/824408405 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.728+0000 7f8247fff640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 0x7f823c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.929+0000 7f8247fff640 1 -- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 msgr2=0x7f823c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/824408405 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:19.929+0000 7f8247fff640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 0x7f823c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:58:23.605 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:20.330+0000 7f8247fff640 1 -- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 msgr2=0x7f823c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/824408405 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:20.330+0000 7f8247fff640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 0x7f823c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:21.131+0000 7f8247fff640 1 -- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 msgr2=0x7f823c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/824408405 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:21.131+0000 7f8247fff640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 0x7f823c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:21.938+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f824006b070 con 0x7f82501066b0 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:21.938+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 msgr2=0x7f823c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:21.938+0000 7f824d7fa640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 0x7f823c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.940+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f8240045460 con 0x7f82501066b0 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.940+0000 7f824d7fa640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f823c03c890 0x7f823c03ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.940+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8250106b30 con 0x7f823c03c890 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.940+0000 7f8247fff640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f823c03c890 0x7f823c03ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.941+0000 7f8247fff640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f823c03c890 0x7f823c03ec80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8238003980 tx=0x7f8238006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.941+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f8250106b30 con 0x7f823c03c890 2024-09-12T01:58:23.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.948+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f825010ade0 con 0x7f823c03c890 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f824d7fa640 1 -- 172.21.15.100:0/1049195067 <== mgr.14150 v2:172.21.15.100:6800/3532459665 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f825010ade0 con 0x7f823c03c890 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f823c03c890 msgr2=0x7f823c03ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f823c03c890 0x7f823c03ec80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8238003980 tx=0x7f8238006e10 comp rx=0 tx=0).stop 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 msgr2=0x7f825007ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f825007ba00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8240030560 tx=0x7f8240032670 comp rx=0 tx=0).stop 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 shutdown_connections 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f823c03c890 0x7f823c03ec80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:6800/824408405,v1:172.21.15.100:6801/824408405] conn(0x7f823c038fc0 0x7f823c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 --2- 172.21.15.100:0/1049195067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82501066b0 0x7f825007ba00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 >> 172.21.15.100:0/1049195067 conn(0x7f8250101e80 msgr2=0x7f8250102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 shutdown_connections 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:22.949+0000 7f8256113640 1 -- 172.21.15.100:0/1049195067 wait complete. 2024-09-12T01:58:23.607 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 9 is available 2024-09-12T01:58:23.608 INFO:teuthology.orchestra.run.smithi100.stdout:Generating a dashboard self-signed certificate... 2024-09-12T01:58:24.196 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-mon[31179]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-mon[31179]: mgrmap e11: x(active, since 1.00577s) 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-mon[31179]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:23.891+0000 7f90bb56e640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:58:23] ENGINE Error in HTTPServer.serve 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: Traceback (most recent call last): 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self._connections.run(self.expiration_interval) 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:58:24.197 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self._run(expiration_interval) 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: s = self.context.wrap_socket( 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: return self.sslsocket_class._create( 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self.do_handshake() 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: self._sslobj.do_handshake() 2024-09-12T01:58:24.198 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:58:24.199 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 01:58:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T01:58:24.862 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T01:58:24.862 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fda7f8640 1 Processor -- start 2024-09-12T01:58:24.862 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fda7f8640 1 -- start start 2024-09-12T01:58:24.862 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fda7f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd4107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.862 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fda7f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd41081d0 con 0x7f2fd4107800 2024-09-12T01:58:24.862 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd4107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.863 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd4107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44820/0 (socket says 172.21.15.100:44820) 2024-09-12T01:58:24.863 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fd3fff640 1 -- 172.21.15.100:0/896093149 learned_addr learned my addr 172.21.15.100:0/896093149 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:24.863 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.007+0000 7f2fd3fff640 1 -- 172.21.15.100:0/896093149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd4108a00 con 0x7f2fd4107800 2024-09-12T01:58:24.863 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.008+0000 7f2fd3fff640 1 --2- 172.21.15.100:0/896093149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd4107c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009820 tx=0x7f2fc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af9a3d46b006c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.863 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.008+0000 7f2fd2ffd640 1 -- 172.21.15.100:0/896093149 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc4037070 con 0x7f2fd4107800 2024-09-12T01:58:24.863 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.008+0000 7f2fd2ffd640 1 -- 172.21.15.100:0/896093149 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fc4032920 con 0x7f2fd4107800 2024-09-12T01:58:24.864 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.008+0000 7f2fd2ffd640 1 -- 172.21.15.100:0/896093149 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc4030810 con 0x7f2fd4107800 2024-09-12T01:58:24.864 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 -- 172.21.15.100:0/896093149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 msgr2=0x7f2fd4107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.864 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 --2- 172.21.15.100:0/896093149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd4107c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009820 tx=0x7f2fc402a270 comp rx=0 tx=0).stop 2024-09-12T01:58:24.864 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 -- 172.21.15.100:0/896093149 shutdown_connections 2024-09-12T01:58:24.864 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 --2- 172.21.15.100:0/896093149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd4107c00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.865 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 -- 172.21.15.100:0/896093149 >> 172.21.15.100:0/896093149 conn(0x7f2fd4102ff0 msgr2=0x7f2fd4105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.865 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 -- 172.21.15.100:0/896093149 shutdown_connections 2024-09-12T01:58:24.865 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 -- 172.21.15.100:0/896093149 wait complete. 2024-09-12T01:58:24.865 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.009+0000 7f2fda7f8640 1 Processor -- start 2024-09-12T01:58:24.869 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fda7f8640 1 -- start start 2024-09-12T01:58:24.869 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fda7f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.869 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fda7f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd410bdb0 con 0x7f2fd4107800 2024-09-12T01:58:24.869 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.870 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44828/0 (socket says 172.21.15.100:44828) 2024-09-12T01:58:24.870 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd3fff640 1 -- 172.21.15.100:0/23308138 learned_addr learned my addr 172.21.15.100:0/23308138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:24.870 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd3fff640 1 -- 172.21.15.100:0/23308138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd419bdd0 con 0x7f2fd4107800 2024-09-12T01:58:24.870 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd3fff640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd419b890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4030560 tx=0x7f2fc4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.870 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd17fa640 1 -- 172.21.15.100:0/23308138 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc4037040 con 0x7f2fd4107800 2024-09-12T01:58:24.870 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd17fa640 1 -- 172.21.15.100:0/23308138 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fc4040070 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd419c060 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.010+0000 7f2fd17fa640 1 -- 172.21.15.100:0/23308138 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc403a6d0 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.011+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd419ed50 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.011+0000 7f2fd17fa640 1 -- 172.21.15.100:0/23308138 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f2fc403a940 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.011+0000 7f2fd17fa640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2fbc038fc0 0x7f2fbc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.011+0000 7f2fd17fa640 1 -- 172.21.15.100:0/23308138 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2fc403bb20 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.012+0000 7f2fd37fe640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2fbc038fc0 0x7f2fbc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.012+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd410bf30 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.012+0000 7f2fd37fe640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2fbc038fc0 0x7f2fbc03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098c0 tx=0x7f2fc8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.016+0000 7f2fd17fa640 1 -- 172.21.15.100:0/23308138 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fc4044c70 con 0x7f2fd4107800 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.196+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f2fd41043a0 con 0x7f2fbc038fc0 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.303+0000 7f2fd17fa640 1 -- 172.21.15.100:0/23308138 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f2fd41043a0 con 0x7f2fbc038fc0 2024-09-12T01:58:24.871 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2fbc038fc0 msgr2=0x7f2fbc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2fbc038fc0 0x7f2fbc03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098c0 tx=0x7f2fc8006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 msgr2=0x7f2fd419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd419b890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4030560 tx=0x7f2fc4032670 comp rx=0 tx=0).stop 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 shutdown_connections 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2fbc038fc0 0x7f2fbc03b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 --2- 172.21.15.100:0/23308138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fd4107800 0x7f2fd419b890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 >> 172.21.15.100:0/23308138 conn(0x7f2fd4102ff0 msgr2=0x7f2fd4103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 shutdown_connections 2024-09-12T01:58:24.872 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:24.305+0000 7f2fda7f8640 1 -- 172.21.15.100:0/23308138 wait complete. 2024-09-12T01:58:24.873 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial admin user... 2024-09-12T01:58:24.975 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:23] ENGINE Bus STARTING 2024-09-12T01:58:24.975 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:23] ENGINE Serving on http://172.21.15.100:8765 2024-09-12T01:58:24.975 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:23] ENGINE Serving on https://172.21.15.100:7150 2024-09-12T01:58:24.975 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:23] ENGINE Bus STARTED 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: [12/Sep/2024:01:58:23] ENGINE Error in HTTPServer.serve 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: Traceback (most recent call last): 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._run(expiration_interval) 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: s = self.context.wrap_socket( 2024-09-12T01:58:24.976 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout: return self.sslsocket_class._create( 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout: self.do_handshake() 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout: self._sslobj.do_handshake() 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: mgrmap e12: x(active, since 2s) 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:24.977 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:26.233 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:25 smithi100 ceph-mon[31179]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:26.233 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:26.233 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:26.499 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$KnCl0n/uPQAULl54PR.t9uX6hMhketvFKeASEq3/3ZbL361zKu6EG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726106305, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T01:58:26.499 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.334+0000 7f02f50b6640 1 Processor -- start 2024-09-12T01:58:26.499 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.334+0000 7f02f50b6640 1 -- start start 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.334+0000 7f02f50b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f0107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.334+0000 7f02f50b6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02f01081d0 con 0x7f02f0107800 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.335+0000 7f02eed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f0107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.335+0000 7f02eed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f0107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44838/0 (socket says 172.21.15.100:44838) 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.335+0000 7f02eed9d640 1 -- 172.21.15.100:0/2105081546 learned_addr learned my addr 172.21.15.100:0/2105081546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.335+0000 7f02eed9d640 1 -- 172.21.15.100:0/2105081546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f0108a00 con 0x7f02f0107800 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.335+0000 7f02eed9d640 1 --2- 172.21.15.100:0/2105081546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f0107c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009820 tx=0x7f02e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f416f83dcfaf486f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02ee59c640 1 -- 172.21.15.100:0/2105081546 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02e0037070 con 0x7f02f0107800 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02ee59c640 1 -- 172.21.15.100:0/2105081546 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e0032920 con 0x7f02f0107800 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02ee59c640 1 -- 172.21.15.100:0/2105081546 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02e0030810 con 0x7f02f0107800 2024-09-12T01:58:26.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02f50b6640 1 -- 172.21.15.100:0/2105081546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 msgr2=0x7f02f0107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02f50b6640 1 --2- 172.21.15.100:0/2105081546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f0107c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009820 tx=0x7f02e002a270 comp rx=0 tx=0).stop 2024-09-12T01:58:26.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02f50b6640 1 -- 172.21.15.100:0/2105081546 shutdown_connections 2024-09-12T01:58:26.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02f50b6640 1 --2- 172.21.15.100:0/2105081546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f0107c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02f50b6640 1 -- 172.21.15.100:0/2105081546 >> 172.21.15.100:0/2105081546 conn(0x7f02f0102ff0 msgr2=0x7f02f0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02f50b6640 1 -- 172.21.15.100:0/2105081546 shutdown_connections 2024-09-12T01:58:26.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.336+0000 7f02f50b6640 1 -- 172.21.15.100:0/2105081546 wait complete. 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.337+0000 7f02f50b6640 1 Processor -- start 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.337+0000 7f02f50b6640 1 -- start start 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.337+0000 7f02f50b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f007db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.337+0000 7f02f50b6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02f010bdb0 con 0x7f02f0107800 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.337+0000 7f02eed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f007db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02eed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f007db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44844/0 (socket says 172.21.15.100:44844) 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02eed9d640 1 -- 172.21.15.100:0/220020026 learned_addr learned my addr 172.21.15.100:0/220020026 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02eed9d640 1 -- 172.21.15.100:0/220020026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f007e060 con 0x7f02f0107800 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02eed9d640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f007db20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02e00097f0 tx=0x7f02e00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02ecd99640 1 -- 172.21.15.100:0/220020026 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02e0037040 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02ecd99640 1 -- 172.21.15.100:0/220020026 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e0030c40 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f007c250 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02ecd99640 1 -- 172.21.15.100:0/220020026 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02e003a5b0 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.338+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f007c790 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.339+0000 7f02ecd99640 1 -- 172.21.15.100:0/220020026 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f02e003a7a0 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.339+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f010bf30 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.339+0000 7f02ecd99640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f02dc039020 0x7f02dc03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.339+0000 7f02ecd99640 1 -- 172.21.15.100:0/220020026 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f02e006c610 con 0x7f02f0107800 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.339+0000 7f02e7fff640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f02dc039020 0x7f02dc03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.340+0000 7f02e7fff640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f02dc039020 0x7f02dc03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02d80098c0 tx=0x7f02d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.344+0000 7f02ecd99640 1 -- 172.21.15.100:0/220020026 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02e0031c00 con 0x7f02f0107800 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.532+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f02f0107c80 con 0x7f02dc039020 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.762+0000 7f02ecd99640 1 -- 172.21.15.100:0/220020026 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f02f0107c80 con 0x7f02dc039020 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f02dc039020 msgr2=0x7f02dc03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f02dc039020 0x7f02dc03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02d80098c0 tx=0x7f02d8006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 msgr2=0x7f02f007db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f007db20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02e00097f0 tx=0x7f02e00327b0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 shutdown_connections 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f02dc039020 0x7f02dc03b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 --2- 172.21.15.100:0/220020026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02f0107800 0x7f02f007db20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 >> 172.21.15.100:0/220020026 conn(0x7f02f0102ff0 msgr2=0x7f02f0103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 shutdown_connections 2024-09-12T01:58:26.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:25.764+0000 7f02f50b6640 1 -- 172.21.15.100:0/220020026 wait complete. 2024-09-12T01:58:26.509 INFO:teuthology.orchestra.run.smithi100.stdout:Fetching dashboard port number... 2024-09-12T01:58:27.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:26 smithi100 ceph-mon[31179]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:28.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:27 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1269434098' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T01:58:28.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T01:58:28.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.318+0000 7fbbb530a640 1 Processor -- start 2024-09-12T01:58:28.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.318+0000 7fbbb530a640 1 -- start start 2024-09-12T01:58:28.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.318+0000 7fbbb530a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb0106ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.318+0000 7fbbb530a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0107080 con 0x7fbbb01066b0 2024-09-12T01:58:28.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.318+0000 7fbbaeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb0106ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.318+0000 7fbbaeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb0106ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44858/0 (socket says 172.21.15.100:44858) 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.318+0000 7fbbaeffd640 1 -- 172.21.15.100:0/2997122256 learned_addr learned my addr 172.21.15.100:0/2997122256 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.319+0000 7fbbaeffd640 1 -- 172.21.15.100:0/2997122256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb01078b0 con 0x7fbbb01066b0 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.319+0000 7fbbaeffd640 1 --2- 172.21.15.100:0/2997122256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb0106ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009820 tx=0x7fbba002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b11fc23277226f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbadffb640 1 -- 172.21.15.100:0/2997122256 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba0037070 con 0x7fbbb01066b0 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbadffb640 1 -- 172.21.15.100:0/2997122256 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba0032920 con 0x7fbbb01066b0 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbadffb640 1 -- 172.21.15.100:0/2997122256 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba0030810 con 0x7fbbb01066b0 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbb530a640 1 -- 172.21.15.100:0/2997122256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 msgr2=0x7fbbb0106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbb530a640 1 --2- 172.21.15.100:0/2997122256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb0106ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009820 tx=0x7fbba002a270 comp rx=0 tx=0).stop 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbb530a640 1 -- 172.21.15.100:0/2997122256 shutdown_connections 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbb530a640 1 --2- 172.21.15.100:0/2997122256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb0106ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbb530a640 1 -- 172.21.15.100:0/2997122256 >> 172.21.15.100:0/2997122256 conn(0x7fbbb0101e60 msgr2=0x7fbbb0104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbb530a640 1 -- 172.21.15.100:0/2997122256 shutdown_connections 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.320+0000 7fbbb530a640 1 -- 172.21.15.100:0/2997122256 wait complete. 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.321+0000 7fbbb530a640 1 Processor -- start 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.321+0000 7fbbb530a640 1 -- start start 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.321+0000 7fbbb530a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb007ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.321+0000 7fbbb530a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb010ac60 con 0x7fbbb01066b0 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.321+0000 7fbbaeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb007ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.321+0000 7fbbaeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb007ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44864/0 (socket says 172.21.15.100:44864) 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.321+0000 7fbbaeffd640 1 -- 172.21.15.100:0/1269434098 learned_addr learned my addr 172.21.15.100:0/1269434098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.322+0000 7fbbaeffd640 1 -- 172.21.15.100:0/1269434098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb019e590 con 0x7fbbb01066b0 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.322+0000 7fbbaeffd640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb007ba00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbba00097f0 tx=0x7fbba00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.322+0000 7fbb97fff640 1 -- 172.21.15.100:0/1269434098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba0037040 con 0x7fbbb01066b0 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.322+0000 7fbb97fff640 1 -- 172.21.15.100:0/1269434098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba0030cc0 con 0x7fbbb01066b0 2024-09-12T01:58:28.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.322+0000 7fbb97fff640 1 -- 172.21.15.100:0/1269434098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba003a640 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.322+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb019e760 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.322+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb019eb00 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.323+0000 7fbb97fff640 1 -- 172.21.15.100:0/1269434098 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fbba003a940 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.323+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb0106b30 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.323+0000 7fbb97fff640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb98038fc0 0x7fbb9803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.323+0000 7fbb97fff640 1 -- 172.21.15.100:0/1269434098 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbba006c650 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.323+0000 7fbbae7fc640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb98038fc0 0x7fbb9803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.324+0000 7fbbae7fc640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb98038fc0 0x7fbb9803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbba40098c0 tx=0x7fbba4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.328+0000 7fbb97fff640 1 -- 172.21.15.100:0/1269434098 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbba003ba40 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.498+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fbbb019ed80 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.499+0000 7fbb97fff640 1 -- 172.21.15.100:0/1269434098 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fbba003ad80 con 0x7fbbb01066b0 2024-09-12T01:58:28.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb98038fc0 msgr2=0x7fbb9803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb98038fc0 0x7fbb9803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbba40098c0 tx=0x7fbba4006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 msgr2=0x7fbbb007ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb007ba00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbba00097f0 tx=0x7fbba00327b0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 shutdown_connections 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb98038fc0 0x7fbb9803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 --2- 172.21.15.100:0/1269434098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbb01066b0 0x7fbbb007ba00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 >> 172.21.15.100:0/1269434098 conn(0x7fbbb0101e60 msgr2=0x7fbbb0102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 shutdown_connections 2024-09-12T01:58:28.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:27.501+0000 7fbbb530a640 1 -- 172.21.15.100:0/1269434098 wait complete. 2024-09-12T01:58:28.401 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:58:28.401 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-12T01:58:28.408 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:58:28.408 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-12T01:58:28.408 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-12T01:58:28.408 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T01:58:28.410 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph Dashboard is now available at: 2024-09-12T01:58:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: URL: https://smithi100.front.sepia.ceph.com:8443/ 2024-09-12T01:58:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: User: admin 2024-09-12T01:58:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: Password: odbyargsrt 2024-09-12T01:58:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:28.411 INFO:teuthology.orchestra.run.smithi100.stdout:Saving cluster configuration to /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config directory 2024-09-12T01:58:29.315 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:28 smithi100 ceph-mon[31179]: mgrmap e13: x(active, since 6s) 2024-09-12T01:58:29.621 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd98f1640 1 Processor -- start 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd98f1640 1 -- start start 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd98f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd410a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd98f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd407be00 con 0x7f9fd4108280 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd410a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd410a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44874/0 (socket says 172.21.15.100:44874) 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd2ffd640 1 -- 172.21.15.100:0/1593242510 learned_addr learned my addr 172.21.15.100:0/1593242510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.769+0000 7f9fd2ffd640 1 -- 172.21.15.100:0/1593242510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd410abb0 con 0x7f9fd4108280 2024-09-12T01:58:29.628 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.770+0000 7f9fd2ffd640 1 --2- 172.21.15.100:0/1593242510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd410a670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009820 tx=0x7f9fc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e02e160c62d8f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.770+0000 7f9fd27fc640 1 -- 172.21.15.100:0/1593242510 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4037070 con 0x7f9fd4108280 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.770+0000 7f9fd27fc640 1 -- 172.21.15.100:0/1593242510 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc4032920 con 0x7f9fd4108280 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.770+0000 7f9fd27fc640 1 -- 172.21.15.100:0/1593242510 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4030810 con 0x7f9fd4108280 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1593242510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 msgr2=0x7f9fd410a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 --2- 172.21.15.100:0/1593242510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd410a670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009820 tx=0x7f9fc402a270 comp rx=0 tx=0).stop 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1593242510 shutdown_connections 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 --2- 172.21.15.100:0/1593242510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd410a670 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1593242510 >> 172.21.15.100:0/1593242510 conn(0x7f9fd4101e60 msgr2=0x7f9fd4104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1593242510 shutdown_connections 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1593242510 wait complete. 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 Processor -- start 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.771+0000 7f9fd98f1640 1 -- start start 2024-09-12T01:58:29.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd98f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd98f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd410bc30 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44884/0 (socket says 172.21.15.100:44884) 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd2ffd640 1 -- 172.21.15.100:0/1271659945 learned_addr learned my addr 172.21.15.100:0/1271659945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd2ffd640 1 -- 172.21.15.100:0/1271659945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd419bce0 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd2ffd640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd419b7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4030380 tx=0x7f9fc4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd88ef640 1 -- 172.21.15.100:0/1271659945 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4037040 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd88ef640 1 -- 172.21.15.100:0/1271659945 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc4040070 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd419bf70 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd88ef640 1 -- 172.21.15.100:0/1271659945 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc403a7b0 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.772+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd419ec60 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.773+0000 7f9fd88ef640 1 -- 172.21.15.100:0/1271659945 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f9fc403a9e0 con 0x7f9fd4108280 2024-09-12T01:58:29.630 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.773+0000 7f9fd88ef640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9fc00390c0 0x7f9fc003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.773+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd41086e0 con 0x7f9fd4108280 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.773+0000 7f9fd88ef640 1 -- 172.21.15.100:0/1271659945 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9fc406ca30 con 0x7f9fd4108280 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.773+0000 7f9fca7fc640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9fc00390c0 0x7f9fc003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.774+0000 7f9fca7fc640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9fc00390c0 0x7f9fc003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0098c0 tx=0x7f9fbc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:28.778+0000 7f9fd88ef640 1 -- 172.21.15.100:0/1271659945 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fc4039ba0 con 0x7f9fd4108280 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.031+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f9fd419ee30 con 0x7f9fd4108280 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.033+0000 7f9fd88ef640 1 -- 172.21.15.100:0/1271659945 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f9fc40313a0 con 0x7f9fd4108280 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9fc00390c0 msgr2=0x7f9fc003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9fc00390c0 0x7f9fc003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0098c0 tx=0x7f9fbc006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 msgr2=0x7f9fd419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:29.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd419b7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4030380 tx=0x7f9fc4032670 comp rx=0 tx=0).stop 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 shutdown_connections 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9fc00390c0 0x7f9fc003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 --2- 172.21.15.100:0/1271659945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd4108280 0x7f9fd419b7a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 >> 172.21.15.100:0/1271659945 conn(0x7f9fd4101e60 msgr2=0x7f9fd4102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 shutdown_connections 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-12T01:58:29.035+0000 7f9fd98f1640 1 -- 172.21.15.100:0/1271659945 wait complete. 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:29.632 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: ceph telemetry on 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout:For more information see: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:29.633 INFO:teuthology.orchestra.run.smithi100.stdout:Bootstrap complete. 2024-09-12T01:58:29.664 INFO:tasks.cephadm:Fetching config... 2024-09-12T01:58:29.665 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:58:29.665 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T01:58:29.681 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T01:58:29.681 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:58:29.682 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T01:58:29.738 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T01:58:29.738 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:58:29.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T01:58:29.806 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T01:58:29.806 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:58:29.806 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T01:58:29.867 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T01:58:29.868 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq+dFF7K22gBUAlxsZKPDBHWe4afISgBTpy/0CzQGVtxnkWXczDONhXMREUxyQtzqiyHfJY5p+48XL+aFOXxy9trTBG6jgdm64I+vF30GCI+/K8usLfHOOW6MNeGQJbBIibBOQ9gr6cPouqdsHN66wIKa5RnQ9IGY0UjQ/cq0Zu0fbGqpx7XqWk/unSQiE8CX1cS24hvvPYt232jDdwjANK+Y96PqVLv+L2HvwdUzd14Rid9YjRd7HJQ0lppJY0ZAG/NUOZA+GVayeJ4uVqqmEkq03pYqTHanIXP9fsVIafAiyvgTP3JJFS8pFIrHZJlBUoHe55I56mhaTfHnjxRLGEFbDhXRyl2BMXAUfw7/XG/B8X19P4Ta42rGYaVB8UeaYbVGuMh2J8q/UaozU+DFJ2zQNvoUs9n6Z9S4xqUuaulMCI/sfrsggl6WPQ/AecBzrgnQO7kfi7ghx7ucusirbApREM8YcyPQwvV4joVSYOW5LRGRWdOi1Z2ZFd4jMQk0= ceph-3a2902f2-70aa-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:58:29.951 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq+dFF7K22gBUAlxsZKPDBHWe4afISgBTpy/0CzQGVtxnkWXczDONhXMREUxyQtzqiyHfJY5p+48XL+aFOXxy9trTBG6jgdm64I+vF30GCI+/K8usLfHOOW6MNeGQJbBIibBOQ9gr6cPouqdsHN66wIKa5RnQ9IGY0UjQ/cq0Zu0fbGqpx7XqWk/unSQiE8CX1cS24hvvPYt232jDdwjANK+Y96PqVLv+L2HvwdUzd14Rid9YjRd7HJQ0lppJY0ZAG/NUOZA+GVayeJ4uVqqmEkq03pYqTHanIXP9fsVIafAiyvgTP3JJFS8pFIrHZJlBUoHe55I56mhaTfHnjxRLGEFbDhXRyl2BMXAUfw7/XG/B8X19P4Ta42rGYaVB8UeaYbVGuMh2J8q/UaozU+DFJ2zQNvoUs9n6Z9S4xqUuaulMCI/sfrsggl6WPQ/AecBzrgnQO7kfi7ghx7ucusirbApREM8YcyPQwvV4joVSYOW5LRGRWdOi1Z2ZFd4jMQk0= ceph-3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:29.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq+dFF7K22gBUAlxsZKPDBHWe4afISgBTpy/0CzQGVtxnkWXczDONhXMREUxyQtzqiyHfJY5p+48XL+aFOXxy9trTBG6jgdm64I+vF30GCI+/K8usLfHOOW6MNeGQJbBIibBOQ9gr6cPouqdsHN66wIKa5RnQ9IGY0UjQ/cq0Zu0fbGqpx7XqWk/unSQiE8CX1cS24hvvPYt232jDdwjANK+Y96PqVLv+L2HvwdUzd14Rid9YjRd7HJQ0lppJY0ZAG/NUOZA+GVayeJ4uVqqmEkq03pYqTHanIXP9fsVIafAiyvgTP3JJFS8pFIrHZJlBUoHe55I56mhaTfHnjxRLGEFbDhXRyl2BMXAUfw7/XG/B8X19P4Ta42rGYaVB8UeaYbVGuMh2J8q/UaozU+DFJ2zQNvoUs9n6Z9S4xqUuaulMCI/sfrsggl6WPQ/AecBzrgnQO7kfi7ghx7ucusirbApREM8YcyPQwvV4joVSYOW5LRGRWdOi1Z2ZFd4jMQk0= ceph-3a2902f2-70aa-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:58:30.005 INFO:teuthology.orchestra.run.smithi117.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq+dFF7K22gBUAlxsZKPDBHWe4afISgBTpy/0CzQGVtxnkWXczDONhXMREUxyQtzqiyHfJY5p+48XL+aFOXxy9trTBG6jgdm64I+vF30GCI+/K8usLfHOOW6MNeGQJbBIibBOQ9gr6cPouqdsHN66wIKa5RnQ9IGY0UjQ/cq0Zu0fbGqpx7XqWk/unSQiE8CX1cS24hvvPYt232jDdwjANK+Y96PqVLv+L2HvwdUzd14Rid9YjRd7HJQ0lppJY0ZAG/NUOZA+GVayeJ4uVqqmEkq03pYqTHanIXP9fsVIafAiyvgTP3JJFS8pFIrHZJlBUoHe55I56mhaTfHnjxRLGEFbDhXRyl2BMXAUfw7/XG/B8X19P4Ta42rGYaVB8UeaYbVGuMh2J8q/UaozU+DFJ2zQNvoUs9n6Z9S4xqUuaulMCI/sfrsggl6WPQ/AecBzrgnQO7kfi7ghx7ucusirbApREM8YcyPQwvV4joVSYOW5LRGRWdOi1Z2ZFd4jMQk0= ceph-3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:30.018 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq+dFF7K22gBUAlxsZKPDBHWe4afISgBTpy/0CzQGVtxnkWXczDONhXMREUxyQtzqiyHfJY5p+48XL+aFOXxy9trTBG6jgdm64I+vF30GCI+/K8usLfHOOW6MNeGQJbBIibBOQ9gr6cPouqdsHN66wIKa5RnQ9IGY0UjQ/cq0Zu0fbGqpx7XqWk/unSQiE8CX1cS24hvvPYt232jDdwjANK+Y96PqVLv+L2HvwdUzd14Rid9YjRd7HJQ0lppJY0ZAG/NUOZA+GVayeJ4uVqqmEkq03pYqTHanIXP9fsVIafAiyvgTP3JJFS8pFIrHZJlBUoHe55I56mhaTfHnjxRLGEFbDhXRyl2BMXAUfw7/XG/B8X19P4Ta42rGYaVB8UeaYbVGuMh2J8q/UaozU+DFJ2zQNvoUs9n6Z9S4xqUuaulMCI/sfrsggl6WPQ/AecBzrgnQO7kfi7ghx7ucusirbApREM8YcyPQwvV4joVSYOW5LRGRWdOi1Z2ZFd4jMQk0= ceph-3a2902f2-70aa-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:58:30.060 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq+dFF7K22gBUAlxsZKPDBHWe4afISgBTpy/0CzQGVtxnkWXczDONhXMREUxyQtzqiyHfJY5p+48XL+aFOXxy9trTBG6jgdm64I+vF30GCI+/K8usLfHOOW6MNeGQJbBIibBOQ9gr6cPouqdsHN66wIKa5RnQ9IGY0UjQ/cq0Zu0fbGqpx7XqWk/unSQiE8CX1cS24hvvPYt232jDdwjANK+Y96PqVLv+L2HvwdUzd14Rid9YjRd7HJQ0lppJY0ZAG/NUOZA+GVayeJ4uVqqmEkq03pYqTHanIXP9fsVIafAiyvgTP3JJFS8pFIrHZJlBUoHe55I56mhaTfHnjxRLGEFbDhXRyl2BMXAUfw7/XG/B8X19P4Ta42rGYaVB8UeaYbVGuMh2J8q/UaozU+DFJ2zQNvoUs9n6Z9S4xqUuaulMCI/sfrsggl6WPQ/AecBzrgnQO7kfi7ghx7ucusirbApREM8YcyPQwvV4joVSYOW5LRGRWdOi1Z2ZFd4jMQk0= ceph-3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:30.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T01:58:30.184 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:30 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1271659945' entity='client.admin' 2024-09-12T01:58:30.337 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.810+0000 7fe436535640 1 -- 172.21.15.100:0/3862864205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 msgr2=0x7fe430101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.810+0000 7fe436535640 1 --2- 172.21.15.100:0/3862864205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430101a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe420009880 tx=0x7fe42002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.810+0000 7fe436535640 1 -- 172.21.15.100:0/3862864205 shutdown_connections 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.810+0000 7fe436535640 1 --2- 172.21.15.100:0/3862864205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430101a20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.810+0000 7fe436535640 1 -- 172.21.15.100:0/3862864205 >> 172.21.15.100:0/3862864205 conn(0x7fe4300fcdf0 msgr2=0x7fe4300ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.810+0000 7fe436535640 1 -- 172.21.15.100:0/3862864205 shutdown_connections 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.810+0000 7fe436535640 1 -- 172.21.15.100:0/3862864205 wait complete. 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.811+0000 7fe436535640 1 Processor -- start 2024-09-12T01:58:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.811+0000 7fe436535640 1 -- start start 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.811+0000 7fe436535640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.811+0000 7fe436535640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe430107730 con 0x7fe430101620 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.811+0000 7fe42ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.811+0000 7fe42ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44896/0 (socket says 172.21.15.100:44896) 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.811+0000 7fe42ffff640 1 -- 172.21.15.100:0/4134869446 learned_addr learned my addr 172.21.15.100:0/4134869446 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.812+0000 7fe42ffff640 1 -- 172.21.15.100:0/4134869446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4301972e0 con 0x7fe430101620 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.812+0000 7fe42ffff640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430196da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe420004f60 tx=0x7fe4200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.812+0000 7fe42d7fa640 1 -- 172.21.15.100:0/4134869446 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe42003f070 con 0x7fe430101620 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.812+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe430197570 con 0x7fe430101620 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.812+0000 7fe42d7fa640 1 -- 172.21.15.100:0/4134869446 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe420004d40 con 0x7fe430101620 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.812+0000 7fe42d7fa640 1 -- 172.21.15.100:0/4134869446 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe420035030 con 0x7fe430101620 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.812+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43019a260 con 0x7fe430101620 2024-09-12T01:58:30.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.813+0000 7fe42d7fa640 1 -- 172.21.15.100:0/4134869446 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fe420042070 con 0x7fe430101620 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.813+0000 7fe42d7fa640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe418039060 0x7fe41803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.813+0000 7fe42d7fa640 1 -- 172.21.15.100:0/4134869446 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe42006ccd0 con 0x7fe430101620 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.813+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe430107eb0 con 0x7fe430101620 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.813+0000 7fe42f7fe640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe418039060 0x7fe41803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.813+0000 7fe42f7fe640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe418039060 0x7fe41803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe4240098c0 tx=0x7fe424006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.818+0000 7fe42d7fa640 1 -- 172.21.15.100:0/4134869446 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe420040260 con 0x7fe430101620 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.987+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fe43002d7c0 con 0x7fe430101620 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.989+0000 7fe42d7fa640 1 -- 172.21.15.100:0/4134869446 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fe4200307a0 con 0x7fe430101620 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe418039060 msgr2=0x7fe41803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe418039060 0x7fe41803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe4240098c0 tx=0x7fe424006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 msgr2=0x7fe430196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430196da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe420004f60 tx=0x7fe4200048f0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 shutdown_connections 2024-09-12T01:58:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe418039060 0x7fe41803b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 --2- 172.21.15.100:0/4134869446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe430101620 0x7fe430196da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 >> 172.21.15.100:0/4134869446 conn(0x7fe4300fcdf0 msgr2=0x7fe4300fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 shutdown_connections 2024-09-12T01:58:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:30.992+0000 7fe436535640 1 -- 172.21.15.100:0/4134869446 wait complete. 2024-09-12T01:58:31.592 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T01:58:31.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T01:58:32.173 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:32.297 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:31 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4134869446' entity='client.admin' 2024-09-12T01:58:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.793+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/3606543496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 msgr2=0x7f7d74101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.793+0000 7f7d7ba5b640 1 --2- 172.21.15.100:0/3606543496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74101a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009880 tx=0x7f7d7002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.793+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/3606543496 shutdown_connections 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.793+0000 7f7d7ba5b640 1 --2- 172.21.15.100:0/3606543496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74101a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.793+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/3606543496 >> 172.21.15.100:0/3606543496 conn(0x7f7d740fcdf0 msgr2=0x7f7d740ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.793+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/3606543496 shutdown_connections 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.793+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/3606543496 wait complete. 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d7ba5b640 1 Processor -- start 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d7ba5b640 1 -- start start 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d7ba5b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d7ba5b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74107750 con 0x7f7d74101640 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d797f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d797f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44912/0 (socket says 172.21.15.100:44912) 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d797f7640 1 -- 172.21.15.100:0/34884317 learned_addr learned my addr 172.21.15.100:0/34884317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.794+0000 7f7d797f7640 1 -- 172.21.15.100:0/34884317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d74197370 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.795+0000 7f7d797f7640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74196e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009230 tx=0x7f7d700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.795+0000 7f7d6a7fc640 1 -- 172.21.15.100:0/34884317 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d7003f070 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.795+0000 7f7d6a7fc640 1 -- 172.21.15.100:0/34884317 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d70003ad0 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.795+0000 7f7d6a7fc640 1 -- 172.21.15.100:0/34884317 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d70035030 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.795+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d74197600 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.795+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d7419a2f0 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.796+0000 7f7d6a7fc640 1 -- 172.21.15.100:0/34884317 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f7d70042070 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.796+0000 7f7d6a7fc640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d600390c0 0x7f7d6003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.796+0000 7f7d6a7fc640 1 -- 172.21.15.100:0/34884317 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7d7006cca0 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.796+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d74107ed0 con 0x7f7d74101640 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.796+0000 7f7d78ff6640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d600390c0 0x7f7d6003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.796+0000 7f7d78ff6640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d600390c0 0x7f7d6003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d640098c0 tx=0x7f7d64006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.801+0000 7f7d6a7fc640 1 -- 172.21.15.100:0/34884317 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d70040260 con 0x7f7d74101640 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.978+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f7d74062630 con 0x7f7d600390c0 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.981+0000 7f7d6a7fc640 1 -- 172.21.15.100:0/34884317 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7d74062630 con 0x7f7d600390c0 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d600390c0 msgr2=0x7f7d6003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d600390c0 0x7f7d6003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d640098c0 tx=0x7f7d64006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 msgr2=0x7f7d74196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74196e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009230 tx=0x7f7d700048f0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 shutdown_connections 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d600390c0 0x7f7d6003b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 --2- 172.21.15.100:0/34884317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d74101640 0x7f7d74196e30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 >> 172.21.15.100:0/34884317 conn(0x7f7d740fcdf0 msgr2=0x7f7d740fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 shutdown_connections 2024-09-12T01:58:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:32.983+0000 7f7d7ba5b640 1 -- 172.21.15.100:0/34884317 wait complete. 2024-09-12T01:58:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:58:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:33.812 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi117 2024-09-12T01:58:33.812 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:58:33.812 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:58:33.831 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:58:33.832 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:33.890 INFO:tasks.cephadm:Adding host smithi117 to orchestrator... 2024-09-12T01:58:33.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch host add smithi117 2024-09-12T01:58:34.361 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:34 smithi100 ceph-mon[31179]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:34.361 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:34 smithi100 ceph-mon[31179]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:58:34.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:34.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:34.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:34.462 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.896+0000 7fe675e4c640 1 -- 172.21.15.100:0/2479357079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 msgr2=0x7fe670100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.896+0000 7fe675e4c640 1 --2- 172.21.15.100:0/2479357079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe670100770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe660009c20 tx=0x7fe66002aa90 comp rx=0 tx=0).stop 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.896+0000 7fe675e4c640 1 -- 172.21.15.100:0/2479357079 shutdown_connections 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.896+0000 7fe675e4c640 1 --2- 172.21.15.100:0/2479357079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe670100770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.896+0000 7fe675e4c640 1 -- 172.21.15.100:0/2479357079 >> 172.21.15.100:0/2479357079 conn(0x7fe6700fc1a0 msgr2=0x7fe6700fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.896+0000 7fe675e4c640 1 -- 172.21.15.100:0/2479357079 shutdown_connections 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.897+0000 7fe675e4c640 1 -- 172.21.15.100:0/2479357079 wait complete. 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.897+0000 7fe675e4c640 1 Processor -- start 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.897+0000 7fe675e4c640 1 -- start start 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.897+0000 7fe675e4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe6701993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.897+0000 7fe675e4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe67010ded0 con 0x7fe670100390 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe6701993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe6701993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54404/0 (socket says 172.21.15.100:54404) 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66f7fe640 1 -- 172.21.15.100:0/483386104 learned_addr learned my addr 172.21.15.100:0/483386104 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66f7fe640 1 -- 172.21.15.100:0/483386104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6701998e0 con 0x7fe670100390 2024-09-12T01:58:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66f7fe640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe6701993a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe660005e30 tx=0x7fe66002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66cff9640 1 -- 172.21.15.100:0/483386104 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe660047070 con 0x7fe670100390 2024-09-12T01:58:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66cff9640 1 -- 172.21.15.100:0/483386104 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe660003df0 con 0x7fe670100390 2024-09-12T01:58:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe670199b70 con 0x7fe670100390 2024-09-12T01:58:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe66cff9640 1 -- 172.21.15.100:0/483386104 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe660033050 con 0x7fe670100390 2024-09-12T01:58:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.898+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe670199fd0 con 0x7fe670100390 2024-09-12T01:58:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.899+0000 7fe66cff9640 1 -- 172.21.15.100:0/483386104 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fe66004a070 con 0x7fe670100390 2024-09-12T01:58:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.899+0000 7fe66cff9640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe658039060 0x7fe65803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.899+0000 7fe66cff9640 1 -- 172.21.15.100:0/483386104 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe66003e030 con 0x7fe670100390 2024-09-12T01:58:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.899+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67006a740 con 0x7fe670100390 2024-09-12T01:58:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.899+0000 7fe66effd640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe658039060 0x7fe65803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.900+0000 7fe66effd640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe658039060 0x7fe65803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6640098c0 tx=0x7fe664006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:34.904+0000 7fe66cff9640 1 -- 172.21.15.100:0/483386104 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe660051080 con 0x7fe670100390 2024-09-12T01:58:35.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:35.072+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}) -- 0x7fe67019a700 con 0x7fe658039060 2024-09-12T01:58:35.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:35 smithi100 ceph-mon[31179]: Updating smithi100:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:58:35.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:35 smithi100 ceph-mon[31179]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:35.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:35 smithi100 ceph-mon[31179]: Updating smithi100:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:58:36.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:36 smithi100 ceph-mon[31179]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:37.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:37 smithi100 ceph-mon[31179]: Deploying cephadm binary to smithi117 2024-09-12T01:58:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.200+0000 7fe66cff9640 1 -- 172.21.15.100:0/483386104 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe67019a700 con 0x7fe658039060 2024-09-12T01:58:38.202 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi117' with addr '172.21.15.117' 2024-09-12T01:58:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.202+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe658039060 msgr2=0x7fe65803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.202+0000 7fe675e4c640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe658039060 0x7fe65803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6640098c0 tx=0x7fe664006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.202+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 msgr2=0x7fe6701993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.202+0000 7fe675e4c640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe6701993a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe660005e30 tx=0x7fe66002fc10 comp rx=0 tx=0).stop 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.203+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 shutdown_connections 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.203+0000 7fe675e4c640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe658039060 0x7fe65803b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.203+0000 7fe675e4c640 1 --2- 172.21.15.100:0/483386104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe670100390 0x7fe6701993a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.203+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 >> 172.21.15.100:0/483386104 conn(0x7fe6700fc1a0 msgr2=0x7fe6700fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.203+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 shutdown_connections 2024-09-12T01:58:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:38.203+0000 7fe675e4c640 1 -- 172.21.15.100:0/483386104 wait complete. 2024-09-12T01:58:38.812 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:58:39.048 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:39.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:39.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:39 smithi100 ceph-mon[31179]: Added host smithi117 2024-09-12T01:58:39.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:39.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:39.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:39.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.500+0000 7f2de8b60640 1 -- 172.21.15.100:0/2827191486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 msgr2=0x7f2de4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.500+0000 7f2de8b60640 1 --2- 172.21.15.100:0/2827191486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de4107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009880 tx=0x7f2dd402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.500+0000 7f2de8b60640 1 -- 172.21.15.100:0/2827191486 shutdown_connections 2024-09-12T01:58:39.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.500+0000 7f2de8b60640 1 --2- 172.21.15.100:0/2827191486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de4107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.500+0000 7f2de8b60640 1 -- 172.21.15.100:0/2827191486 >> 172.21.15.100:0/2827191486 conn(0x7f2de40fd2b0 msgr2=0x7f2de40ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.500+0000 7f2de8b60640 1 -- 172.21.15.100:0/2827191486 shutdown_connections 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.500+0000 7f2de8b60640 1 -- 172.21.15.100:0/2827191486 wait complete. 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de8b60640 1 Processor -- start 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de8b60640 1 -- start start 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de8b60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de8b60640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2de410bc70 con 0x7f2de4107660 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54420/0 (socket says 172.21.15.100:54420) 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de259c640 1 -- 172.21.15.100:0/3047856552 learned_addr learned my addr 172.21.15.100:0/3047856552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de259c640 1 -- 172.21.15.100:0/3047856552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de40763e0 con 0x7f2de4107660 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.501+0000 7f2de259c640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de40744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009230 tx=0x7f2dd4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.502+0000 7f2dd37fe640 1 -- 172.21.15.100:0/3047856552 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd403f070 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.502+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de4074a90 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.502+0000 7f2dd37fe640 1 -- 172.21.15.100:0/3047856552 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd403bc80 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.502+0000 7f2dd37fe640 1 -- 172.21.15.100:0/3047856552 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd4035030 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.502+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de4074f50 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.502+0000 7f2dd37fe640 1 -- 172.21.15.100:0/3047856552 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2dd4042070 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.503+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de4102d10 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.503+0000 7f2dd37fe640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2dcc039060 0x7f2dcc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.503+0000 7f2dd37fe640 1 -- 172.21.15.100:0/3047856552 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2dd406cc40 con 0x7f2de4107660 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.503+0000 7f2de1d9b640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2dcc039060 0x7f2dcc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.503+0000 7f2de1d9b640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2dcc039060 0x7f2dcc03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80098c0 tx=0x7f2dd8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.508+0000 7f2dd37fe640 1 -- 172.21.15.100:0/3047856552 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dd404c350 con 0x7f2de4107660 2024-09-12T01:58:39.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.682+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2de4075a90 con 0x7f2dcc039060 2024-09-12T01:58:39.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.683+0000 7f2dd37fe640 1 -- 172.21.15.100:0/3047856552 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f2de4075a90 con 0x7f2dcc039060 2024-09-12T01:58:39.684 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:39.684 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}] 2024-09-12T01:58:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2dcc039060 msgr2=0x7f2dcc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2dcc039060 0x7f2dcc03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80098c0 tx=0x7f2dd8006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 msgr2=0x7f2de40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de40744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009230 tx=0x7f2dd4003d40 comp rx=0 tx=0).stop 2024-09-12T01:58:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 shutdown_connections 2024-09-12T01:58:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2dcc039060 0x7f2dcc03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 --2- 172.21.15.100:0/3047856552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2de4107660 0x7f2de40744f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 >> 172.21.15.100:0/3047856552 conn(0x7f2de40fd2b0 msgr2=0x7f2de40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 shutdown_connections 2024-09-12T01:58:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:39.685+0000 7f2de8b60640 1 -- 172.21.15.100:0/3047856552 wait complete. 2024-09-12T01:58:40.277 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-12T01:58:40.277 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:58:40.277 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:58:40.297 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:58:40.297 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:40.355 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-12T01:58:40.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch host add smithi189 2024-09-12T01:58:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:40.806 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:40.806 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:40 smithi100 ceph-mon[31179]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:40.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 -- 172.21.15.100:0/671550601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 msgr2=0x7fde10106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 --2- 172.21.15.100:0/671550601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10106970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde00009880 tx=0x7fde0002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 -- 172.21.15.100:0/671550601 shutdown_connections 2024-09-12T01:58:40.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 --2- 172.21.15.100:0/671550601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10106970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 -- 172.21.15.100:0/671550601 >> 172.21.15.100:0/671550601 conn(0x7fde100fc1a0 msgr2=0x7fde100fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:40.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 -- 172.21.15.100:0/671550601 shutdown_connections 2024-09-12T01:58:40.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 -- 172.21.15.100:0/671550601 wait complete. 2024-09-12T01:58:40.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 Processor -- start 2024-09-12T01:58:40.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.992+0000 7fde162ee640 1 -- start start 2024-09-12T01:58:40.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde162ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde162ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fde1010abc0 con 0x7fde10106590 2024-09-12T01:58:40.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde0ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde0ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54436/0 (socket says 172.21.15.100:54436) 2024-09-12T01:58:40.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde0ffff640 1 -- 172.21.15.100:0/1418195394 learned_addr learned my addr 172.21.15.100:0/1418195394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde0ffff640 1 -- 172.21.15.100:0/1418195394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde10197640 con 0x7fde10106590 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde0ffff640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde00009230 tx=0x7fde00003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.993+0000 7fde0d7fa640 1 -- 172.21.15.100:0/1418195394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde0003f070 con 0x7fde10106590 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.994+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde101978d0 con 0x7fde10106590 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.994+0000 7fde0d7fa640 1 -- 172.21.15.100:0/1418195394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde0003bc80 con 0x7fde10106590 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.994+0000 7fde0d7fa640 1 -- 172.21.15.100:0/1418195394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde00035030 con 0x7fde10106590 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.994+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1019b9d0 con 0x7fde10106590 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.994+0000 7fde0d7fa640 1 -- 172.21.15.100:0/1418195394 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fde00042070 con 0x7fde10106590 2024-09-12T01:58:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.995+0000 7fde0d7fa640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fddf8039060 0x7fddf803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:40.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.995+0000 7fde0d7fa640 1 -- 172.21.15.100:0/1418195394 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fde0006cdc0 con 0x7fde10106590 2024-09-12T01:58:40.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.995+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde10101c00 con 0x7fde10106590 2024-09-12T01:58:40.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.995+0000 7fde0f7fe640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fddf8039060 0x7fddf803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:40.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.995+0000 7fde0f7fe640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fddf8039060 0x7fddf803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fde040098c0 tx=0x7fde04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:40.999+0000 7fde0d7fa640 1 -- 172.21.15.100:0/1418195394 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde000314c0 con 0x7fde10106590 2024-09-12T01:58:41.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:41.196+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}) -- 0x7fde10106a50 con 0x7fddf8039060 2024-09-12T01:58:43.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:43.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:43.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: Deploying cephadm binary to smithi189 2024-09-12T01:58:43.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:43.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:43.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:43.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:43.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:58:43.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:43.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:42 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:44.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:43 smithi100 ceph-mon[31179]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T01:58:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:43 smithi100 ceph-mon[31179]: Updating smithi117:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:58:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:43 smithi100 ceph-mon[31179]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:43 smithi100 ceph-mon[31179]: Updating smithi117:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:58:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:43 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:43 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:43 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:44.463 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-12T01:58:44.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.463+0000 7fde0d7fa640 1 -- 172.21.15.100:0/1418195394 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fde10106a50 con 0x7fddf8039060 2024-09-12T01:58:44.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fddf8039060 msgr2=0x7fddf803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fddf8039060 0x7fddf803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fde040098c0 tx=0x7fde04006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 msgr2=0x7fde10197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde00009230 tx=0x7fde00003d40 comp rx=0 tx=0).stop 2024-09-12T01:58:44.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 shutdown_connections 2024-09-12T01:58:44.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fddf8039060 0x7fddf803b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 --2- 172.21.15.100:0/1418195394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde10106590 0x7fde10197100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 >> 172.21.15.100:0/1418195394 conn(0x7fde100fc1a0 msgr2=0x7fde10069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 shutdown_connections 2024-09-12T01:58:44.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:44.465+0000 7fde162ee640 1 -- 172.21.15.100:0/1418195394 wait complete. 2024-09-12T01:58:45.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:44 smithi100 ceph-mon[31179]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:45.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:45.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:45.048 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:45.077 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:58:45.316 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:45.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.748+0000 7f697a5be640 1 -- 172.21.15.100:0/1037236599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 msgr2=0x7f69741006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.748+0000 7f697a5be640 1 --2- 172.21.15.100:0/1037236599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f69741006f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6964009880 tx=0x7f696402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.748+0000 7f697a5be640 1 -- 172.21.15.100:0/1037236599 shutdown_connections 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.748+0000 7f697a5be640 1 --2- 172.21.15.100:0/1037236599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f69741006f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.748+0000 7f697a5be640 1 -- 172.21.15.100:0/1037236599 >> 172.21.15.100:0/1037236599 conn(0x7f69740fc1a0 msgr2=0x7f69740fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.748+0000 7f697a5be640 1 -- 172.21.15.100:0/1037236599 shutdown_connections 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.748+0000 7f697a5be640 1 -- 172.21.15.100:0/1037236599 wait complete. 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.749+0000 7f697a5be640 1 Processor -- start 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.749+0000 7f697a5be640 1 -- start start 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.749+0000 7f697a5be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f6974199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.749+0000 7f697a5be640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f697410ded0 con 0x7f6974100310 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.749+0000 7f6973fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f6974199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.749+0000 7f6973fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f6974199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56860/0 (socket says 172.21.15.100:56860) 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.749+0000 7f6973fff640 1 -- 172.21.15.100:0/51157918 learned_addr learned my addr 172.21.15.100:0/51157918 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.750+0000 7f6973fff640 1 -- 172.21.15.100:0/51157918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69741998b0 con 0x7f6974100310 2024-09-12T01:58:45.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.750+0000 7f6973fff640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f6974199370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6964009230 tx=0x7f6964003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.750+0000 7f69717fa640 1 -- 172.21.15.100:0/51157918 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696403f070 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.750+0000 7f69717fa640 1 -- 172.21.15.100:0/51157918 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f696403bc80 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.750+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6974199b40 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.750+0000 7f69717fa640 1 -- 172.21.15.100:0/51157918 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6964035030 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.750+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6974199fa0 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.751+0000 7f69717fa640 1 -- 172.21.15.100:0/51157918 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f6964042070 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.751+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697406a7c0 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.751+0000 7f69717fa640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f695c0390c0 0x7f695c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.751+0000 7f69717fa640 1 -- 172.21.15.100:0/51157918 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f696406ccd0 con 0x7f6974100310 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.751+0000 7f69737fe640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f695c0390c0 0x7f695c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:45.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.752+0000 7f69737fe640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f695c0390c0 0x7f695c03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f69680098c0 tx=0x7f6968006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:45.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.756+0000 7f69717fa640 1 -- 172.21.15.100:0/51157918 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6964072020 con 0x7f6974100310 2024-09-12T01:58:45.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.928+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f697419a730 con 0x7f695c0390c0 2024-09-12T01:58:45.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.929+0000 7f69717fa640 1 -- 172.21.15.100:0/51157918 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f697419a730 con 0x7f695c0390c0 2024-09-12T01:58:45.930 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:58:45.930 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.931+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f695c0390c0 msgr2=0x7f695c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.931+0000 7f697a5be640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f695c0390c0 0x7f695c03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f69680098c0 tx=0x7f6968006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.931+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 msgr2=0x7f6974199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.931+0000 7f697a5be640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f6974199370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6964009230 tx=0x7f6964003d40 comp rx=0 tx=0).stop 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.932+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 shutdown_connections 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.932+0000 7f697a5be640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f695c0390c0 0x7f695c03b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.932+0000 7f697a5be640 1 --2- 172.21.15.100:0/51157918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6974100310 0x7f6974199370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:45.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.932+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 >> 172.21.15.100:0/51157918 conn(0x7f69740fc1a0 msgr2=0x7f69740fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:45.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.932+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 shutdown_connections 2024-09-12T01:58:45.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:45.932+0000 7f697a5be640 1 -- 172.21.15.100:0/51157918 wait complete. 2024-09-12T01:58:46.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:46 smithi100 ceph-mon[31179]: Added host smithi189 2024-09-12T01:58:46.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:46.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:46.568 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T01:58:46.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T01:58:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:47.183 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:47 smithi100 ceph-mon[31179]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:47.183 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:47 smithi100 ceph-mon[31179]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 -- 172.21.15.100:0/3453669023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 msgr2=0x7f5e60107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 --2- 172.21.15.100:0/3453669023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e60107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009880 tx=0x7f5e5402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 -- 172.21.15.100:0/3453669023 shutdown_connections 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 --2- 172.21.15.100:0/3453669023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e60107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 -- 172.21.15.100:0/3453669023 >> 172.21.15.100:0/3453669023 conn(0x7f5e600fd2b0 msgr2=0x7f5e600ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 -- 172.21.15.100:0/3453669023 shutdown_connections 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 -- 172.21.15.100:0/3453669023 wait complete. 2024-09-12T01:58:47.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.263+0000 7f5e66d44640 1 Processor -- start 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e66d44640 1 -- start start 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e66d44640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e601970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e66d44640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6010bc70 con 0x7f5e60107660 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e64ae0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e601970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e64ae0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e601970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56868/0 (socket says 172.21.15.100:56868) 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e64ae0640 1 -- 172.21.15.100:0/3365669685 learned_addr learned my addr 172.21.15.100:0/3365669685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e64ae0640 1 -- 172.21.15.100:0/3365669685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e601975e0 con 0x7f5e60107660 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e64ae0640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e601970a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009230 tx=0x7f5e54003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e5dffb640 1 -- 172.21.15.100:0/3365669685 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e5403f070 con 0x7f5e60107660 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e5dffb640 1 -- 172.21.15.100:0/3365669685 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5403bc80 con 0x7f5e60107660 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e601978d0 con 0x7f5e60107660 2024-09-12T01:58:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.264+0000 7f5e5dffb640 1 -- 172.21.15.100:0/3365669685 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e54035030 con 0x7f5e60107660 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.265+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e6019b970 con 0x7f5e60107660 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.265+0000 7f5e5dffb640 1 -- 172.21.15.100:0/3365669685 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f5e54042070 con 0x7f5e60107660 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.266+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e60102d10 con 0x7f5e60107660 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.266+0000 7f5e5dffb640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e50039060 0x7f5e5003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.266+0000 7f5e5dffb640 1 -- 172.21.15.100:0/3365669685 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5e5406ccf0 con 0x7f5e60107660 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.266+0000 7f5e5ffff640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e50039060 0x7f5e5003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.266+0000 7f5e5ffff640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e50039060 0x7f5e5003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0098c0 tx=0x7f5e4c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:47.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.270+0000 7f5e5dffb640 1 -- 172.21.15.100:0/3365669685 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e5404c350 con 0x7f5e60107660 2024-09-12T01:58:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:47.442+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5e60198400 con 0x7f5e60107660 2024-09-12T01:58:48.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.051+0000 7f5e5dffb640 1 -- 172.21.15.100:0/3365669685 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f5e54031e20 con 0x7f5e60107660 2024-09-12T01:58:48.051 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-09-12T01:58:48.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e50039060 msgr2=0x7f5e5003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e50039060 0x7f5e5003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0098c0 tx=0x7f5e4c006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 msgr2=0x7f5e601970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e601970a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009230 tx=0x7f5e54003d40 comp rx=0 tx=0).stop 2024-09-12T01:58:48.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 shutdown_connections 2024-09-12T01:58:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e50039060 0x7f5e5003b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 --2- 172.21.15.100:0/3365669685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e60107660 0x7f5e601970a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 >> 172.21.15.100:0/3365669685 conn(0x7f5e600fd2b0 msgr2=0x7f5e600feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 shutdown_connections 2024-09-12T01:58:48.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:58:48.054+0000 7f5e66d44640 1 -- 172.21.15.100:0/3365669685 wait complete. 2024-09-12T01:58:48.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:48 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3365669685' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:58:48.668 INFO:tasks.cephadm:Adding mon.a on smithi100 2024-09-12T01:58:48.668 INFO:tasks.cephadm:Adding mon.b on smithi117 2024-09-12T01:58:48.668 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-09-12T01:58:48.668 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c' 2024-09-12T01:58:48.919 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:58:49.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:49.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3365669685' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:58:49.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:58:49.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:49.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:49.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:49.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:49.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:58:49.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:49.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.423+0000 7f4269c62640 1 -- 172.21.15.189:0/271780144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 msgr2=0x7f426410c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.423+0000 7f4269c62640 1 --2- 172.21.15.189:0/271780144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f426410c850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4254009880 tx=0x7f425402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.423+0000 7f4269c62640 1 -- 172.21.15.189:0/271780144 shutdown_connections 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.423+0000 7f4269c62640 1 --2- 172.21.15.189:0/271780144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f426410c850 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.423+0000 7f4269c62640 1 -- 172.21.15.189:0/271780144 >> 172.21.15.189:0/271780144 conn(0x7f426406ad60 msgr2=0x7f426406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.423+0000 7f4269c62640 1 -- 172.21.15.189:0/271780144 shutdown_connections 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.423+0000 7f4269c62640 1 -- 172.21.15.189:0/271780144 wait complete. 2024-09-12T01:58:49.429 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.424+0000 7f4269c62640 1 Processor -- start 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.424+0000 7f4269c62640 1 -- start start 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.424+0000 7f4269c62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f42641a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.424+0000 7f4269c62640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4264116680 con 0x7f426410c470 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.424+0000 7f42637fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f42641a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.424+0000 7f42637fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f42641a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.189:58238/0 (socket says 172.21.15.189:58238) 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.424+0000 7f42637fe640 1 -- 172.21.15.189:0/1540345583 learned_addr learned my addr 172.21.15.189:0/1540345583 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.425+0000 7f42637fe640 1 -- 172.21.15.189:0/1540345583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42641a2160 con 0x7f426410c470 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.425+0000 7f42637fe640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f42641a1c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4254009230 tx=0x7f4254003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.425+0000 7f4260ff9640 1 -- 172.21.15.189:0/1540345583 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f425403f070 con 0x7f426410c470 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.426+0000 7f4260ff9640 1 -- 172.21.15.189:0/1540345583 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f425403bc80 con 0x7f426410c470 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.426+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42641a2450 con 0x7f426410c470 2024-09-12T01:58:49.430 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.426+0000 7f4260ff9640 1 -- 172.21.15.189:0/1540345583 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4254035030 con 0x7f426410c470 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.426+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42641a6520 con 0x7f426410c470 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.426+0000 7f4260ff9640 1 -- 172.21.15.189:0/1540345583 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f4254042070 con 0x7f426410c470 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.426+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426410d720 con 0x7f426410c470 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.427+0000 7f4260ff9640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f424c0390c0 0x7f424c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.427+0000 7f4260ff9640 1 -- 172.21.15.189:0/1540345583 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f425406cda0 con 0x7f426410c470 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.427+0000 7f4262ffd640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f424c0390c0 0x7f424c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.427+0000 7f4262ffd640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f424c0390c0 0x7f424c03b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f42580098c0 tx=0x7f4258006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:49.431 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.431+0000 7f4260ff9640 1 -- 172.21.15.189:0/1540345583 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42540314c0 con 0x7f426410c470 2024-09-12T01:58:49.616 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.616+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}) -- 0x7f426410c8d0 con 0x7f424c0390c0 2024-09-12T01:58:49.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.622+0000 7f4260ff9640 1 -- 172.21.15.189:0/1540345583 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f426410c8d0 con 0x7f424c0390c0 2024-09-12T01:58:49.621 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mon update... 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f424c0390c0 msgr2=0x7f424c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f424c0390c0 0x7f424c03b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f42580098c0 tx=0x7f4258006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 msgr2=0x7f42641a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f42641a1c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4254009230 tx=0x7f4254003d40 comp rx=0 tx=0).stop 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 shutdown_connections 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f424c0390c0 0x7f424c03b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 --2- 172.21.15.189:0/1540345583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426410c470 0x7f42641a1c20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 >> 172.21.15.189:0/1540345583 conn(0x7f426406ad60 msgr2=0x7f426410dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 shutdown_connections 2024-09-12T01:58:49.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:49.624+0000 7f4269c62640 1 -- 172.21.15.189:0/1540345583 wait complete. 2024-09-12T01:58:50.171 DEBUG:teuthology.orchestra.run.smithi117:mon.b> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T01:58:50.174 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T01:58:50.176 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:58:50.176 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:58:50.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:58:50.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: Updating smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:58:50.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:50.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: Updating smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:58:50.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:50 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:51 smithi100 ceph-mon[31179]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:51 smithi100 ceph-mon[31179]: Saving service mon spec with placement smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c;count:3 2024-09-12T01:58:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:51 smithi100 ceph-mon[31179]: Deploying daemon mon.c on smithi189 2024-09-12T01:58:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:51 smithi100 ceph-mon[31179]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:51.363 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:58:52.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 -- 172.21.15.189:0/265565309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 msgr2=0x7fbb6c107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 --2- 172.21.15.189:0/265565309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c107a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009880 tx=0x7fbb5c02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 -- 172.21.15.189:0/265565309 shutdown_connections 2024-09-12T01:58:52.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 --2- 172.21.15.189:0/265565309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c107a70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 -- 172.21.15.189:0/265565309 >> 172.21.15.189:0/265565309 conn(0x7fbb6c076250 msgr2=0x7fbb6c076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 -- 172.21.15.189:0/265565309 shutdown_connections 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 -- 172.21.15.189:0/265565309 wait complete. 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.697+0000 7fbb714c1640 1 Processor -- start 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.698+0000 7fbb714c1640 1 -- start start 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.698+0000 7fbb714c1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.698+0000 7fbb714c1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10bce0 con 0x7fbb6c107690 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.698+0000 7fbb6affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.698+0000 7fbb6affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c100800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.189:58258/0 (socket says 172.21.15.189:58258) 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.698+0000 7fbb6affd640 1 -- 172.21.15.189:0/2394794814 learned_addr learned my addr 172.21.15.189:0/2394794814 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:58:52.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.699+0000 7fbb6affd640 1 -- 172.21.15.189:0/2394794814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c1026f0 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.699+0000 7fbb6affd640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c100800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009230 tx=0x7fbb5c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.699+0000 7fbb63fff640 1 -- 172.21.15.189:0/2394794814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c03f070 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.699+0000 7fbb63fff640 1 -- 172.21.15.189:0/2394794814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb5c03bc80 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.699+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c100d40 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.699+0000 7fbb63fff640 1 -- 172.21.15.189:0/2394794814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c035030 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.699+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c101200 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.700+0000 7fbb63fff640 1 -- 172.21.15.189:0/2394794814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fbb5c042070 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.700+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c102d30 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.700+0000 7fbb63fff640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb58039060 0x7fbb5803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.700+0000 7fbb63fff640 1 -- 172.21.15.189:0/2394794814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbb5c06cd60 con 0x7fbb6c107690 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.701+0000 7fbb6a7fc640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb58039060 0x7fbb5803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.701+0000 7fbb6a7fc640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb58039060 0x7fbb5803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb540098c0 tx=0x7fbb54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:52.705 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.706+0000 7fbb63fff640 1 -- 172.21.15.189:0/2394794814 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb5c04c350 con 0x7fbb6c107690 2024-09-12T01:58:52.965 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.965+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbb6c101d30 con 0x7fbb6c107690 2024-09-12T01:58:52.966 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.966+0000 7fbb63fff640 1 -- 172.21.15.189:0/2394794814 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fbb5c031e20 con 0x7fbb6c107690 2024-09-12T01:58:52.966 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:58:52.966 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","modified":"2024-09-12T01:57:34.038532Z","created":"2024-09-12T01:57:34.038532Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:58:52.966 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-12T01:58:52.968 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb58039060 msgr2=0x7fbb5803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.968 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb58039060 0x7fbb5803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb540098c0 tx=0x7fbb54006db0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.968 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 msgr2=0x7fbb6c100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.968 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c100800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009230 tx=0x7fbb5c003d40 comp rx=0 tx=0).stop 2024-09-12T01:58:52.969 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 shutdown_connections 2024-09-12T01:58:52.969 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbb58039060 0x7fbb5803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.969 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 --2- 172.21.15.189:0/2394794814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb6c107690 0x7fbb6c100800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.969 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 >> 172.21.15.189:0/2394794814 conn(0x7fbb6c076250 msgr2=0x7fbb6c0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:52.969 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 shutdown_connections 2024-09-12T01:58:52.969 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:52.968+0000 7fbb714c1640 1 -- 172.21.15.189:0/2394794814 wait complete. 2024-09-12T01:58:53.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:53 smithi100 ceph-mon[31179]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:53.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:53 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/2394794814' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:58:54.222 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:58:54.223 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:58:54.224 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:58:54.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:58:54.226 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:58:54.226 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:58:54.226 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:58:54.226 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:58:54.226 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:58:54.226 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.ttl: 2592000 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:58:54.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8e7d4b47-5abb-4810-bd1e-5716a0a2d8d4 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106334221208, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106334221609, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726106334, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8e7d4b47-5abb-4810-bd1e-5716a0a2d8d4", "db_session_id": "50MCFA86FD3L9ISEU9MN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106334221707, "job": 1, "event": "recovery_finished"} 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T01:58:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559b5933ee00 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: DB pointer 0x559b5943a000 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** DB Stats ** 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:58:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:58:54.230 INFO:journalctl@ceph.mon.c.smithi189.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:58:54.231 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache BinnedLRUCache@0x559b593111f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-12T01:58:54.232 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:58:54.232 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:58:54.232 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:58:54.232 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T01:58:54.232 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: using public_addr v2:172.21.15.189:0/0 -> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-12T01:58:54.232 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: starting mon.c rank -1 at public addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] at bind addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:54.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(???) e0 preinit fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:54.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T01:58:54.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T01:58:54.593 INFO:journalctl@ceph.mon.c.smithi189.stdout: e1 2024-09-12T01:58:54.593 INFO:journalctl@ceph.mon.c.smithi189.stdout: btime 2024-09-12T01:57:36:929801+0000 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout: legacy client fscid: -1 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout: No filesystems configured 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:58:54.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: Added host smithi189 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3365669685' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3365669685' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:54.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: Updating smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: Updating smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:58:54.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: Saving service mon spec with placement smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c;count:3 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: Deploying daemon mon.c on smithi189 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/2394794814' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 ceph-mon[35188]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 bash[35170]: 403fe64726f31e27c3ebc310eb1005ccdde0314192e54aff253c3a67737b8ffc 2024-09-12T01:58:54.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:54 smithi189 systemd[1]: Started Ceph mon.c for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:58:54.774 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:58:54.774 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:58:55.030 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:58:59.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:58:59.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: mon.a calling monitor election 2024-09-12T01:58:59.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: mon.c calling monitor election 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: monmap epoch 2 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: last_changed 2024-09-12T01:58:54.248321+0000 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:58:59.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: min_mon_release 19 (squid) 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: election_strategy: 1 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: fsmap 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: mgrmap e13: x(active, since 37s) 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: overall HEALTH_OK 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:58:59.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:58:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:58:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: mon.a calling monitor election 2024-09-12T01:58:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: mon.c calling monitor election 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: monmap epoch 2 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: last_changed 2024-09-12T01:58:54.248321+0000 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: min_mon_release 19 (squid) 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: election_strategy: 1 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:58:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: fsmap 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: mgrmap e13: x(active, since 37s) 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: overall HEALTH_OK 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:58:59.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:58:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:59.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.853+0000 7fcd395d4640 1 -- 172.21.15.189:0/1938988947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 msgr2=0x7fcd200059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.853+0000 7fcd395d4640 1 --2- 172.21.15.189:0/1938988947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 0x7fcd200059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406a240 tx=0x7fcd2402c490 comp rx=0 tx=0).stop 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.853+0000 7fcd395d4640 1 -- 172.21.15.189:0/1938988947 shutdown_connections 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.853+0000 7fcd395d4640 1 --2- 172.21.15.189:0/1938988947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 0x7fcd200059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.853+0000 7fcd395d4640 1 -- 172.21.15.189:0/1938988947 >> 172.21.15.189:0/1938988947 conn(0x7fcd340fc280 msgr2=0x7fcd340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.853+0000 7fcd395d4640 1 -- 172.21.15.189:0/1938988947 shutdown_connections 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.853+0000 7fcd395d4640 1 -- 172.21.15.189:0/1938988947 wait complete. 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.854+0000 7fcd395d4640 1 Processor -- start 2024-09-12T01:58:59.855 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd395d4640 1 -- start start 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd395d4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 0x7fcd3418f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd395d4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 0x7fcd3418fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd395d4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcd341097a0 con 0x7fcd20003530 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd395d4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd34109620 con 0x7fcd341938a0 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd2a7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 0x7fcd3418fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd2a7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 0x7fcd3418fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:59432/0 (socket says 172.21.15.189:59432) 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.855+0000 7fcd2a7fc640 1 -- 172.21.15.189:0/1289320263 learned_addr learned my addr 172.21.15.189:0/1289320263 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd32ffd640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 0x7fcd3418f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd2a7fc640 1 -- 172.21.15.189:0/1289320263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 msgr2=0x7fcd3418fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd2a7fc640 1 -- 172.21.15.189:0/1289320263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 msgr2=0x7fcd3418fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:58:59.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd2a7fc640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 0x7fcd3418fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd2a7fc640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 0x7fcd3418fe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd32ffd640 1 -- 172.21.15.189:0/1289320263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 msgr2=0x7fcd3418fe80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd32ffd640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 0x7fcd3418fe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd32ffd640 1 -- 172.21.15.189:0/1289320263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd34190580 con 0x7fcd20003530 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd32ffd640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 0x7fcd3418f940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd24005f30 tx=0x7fcd24033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd30ff9640 1 -- 172.21.15.189:0/1289320263 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fcd24038040 con 0x7fcd20003530 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd30ff9640 1 -- 172.21.15.189:0/1289320263 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd24032e00 con 0x7fcd20003530 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.856+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd341a7b20 con 0x7fcd20003530 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.857+0000 7fcd30ff9640 1 -- 172.21.15.189:0/1289320263 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fcd24004a00 con 0x7fcd20003530 2024-09-12T01:58:59.858 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.857+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd341a7ec0 con 0x7fcd20003530 2024-09-12T01:58:59.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.858+0000 7fcd30ff9640 1 -- 172.21.15.189:0/1289320263 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fcd24043020 con 0x7fcd20003530 2024-09-12T01:58:59.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.858+0000 7fcd30ff9640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd14038e50 0x7fcd1403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:59.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.858+0000 7fcd30ff9640 1 -- 172.21.15.189:0/1289320263 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcd2406f580 con 0x7fcd20003530 2024-09-12T01:58:59.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.858+0000 7fcd2a7fc640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd14038e50 0x7fcd1403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:59.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.858+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3406a4f0 con 0x7fcd20003530 2024-09-12T01:58:59.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.859+0000 7fcd2a7fc640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd14038e50 0x7fcd1403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd34191100 tx=0x7fcd1c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:59.864 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:58:59.864+0000 7fcd30ff9640 1 -- 172.21.15.189:0/1289320263 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd2404a020 con 0x7fcd20003530 2024-09-12T01:59:00.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.098+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcd34190e70 con 0x7fcd20003530 2024-09-12T01:59:00.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.098+0000 7fcd30ff9640 1 -- 172.21.15.189:0/1289320263 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7fcd2404b260 con 0x7fcd20003530 2024-09-12T01:59:00.098 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:59:00.098 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","modified":"2024-09-12T01:58:54.248321Z","created":"2024-09-12T01:57:34.038532Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:59:00.099 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-12T01:59:00.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd14038e50 msgr2=0x7fcd1403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd14038e50 0x7fcd1403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd34191100 tx=0x7fcd1c008040 comp rx=0 tx=0).stop 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 msgr2=0x7fcd3418f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 0x7fcd3418f940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd24005f30 tx=0x7fcd24033680 comp rx=0 tx=0).stop 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 shutdown_connections 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd14038e50 0x7fcd1403b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd341938a0 0x7fcd3418fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.100+0000 7fcd395d4640 1 --2- 172.21.15.189:0/1289320263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd20003530 0x7fcd3418f940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.101+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 >> 172.21.15.189:0/1289320263 conn(0x7fcd340fc280 msgr2=0x7fcd34100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.101+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 shutdown_connections 2024-09-12T01:59:00.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:00.101+0000 7fcd395d4640 1 -- 172.21.15.189:0/1289320263 wait complete. 2024-09-12T01:59:00.463 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:00 smithi189 ceph-mon[35188]: Deploying daemon mon.b on smithi117 2024-09-12T01:59:00.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:00 smithi189 ceph-mon[35188]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:00.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:00 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/1289320263' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:59:00.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:00 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:00.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:00 smithi100 ceph-mon[31179]: Deploying daemon mon.b on smithi117 2024-09-12T01:59:00.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:00 smithi100 ceph-mon[31179]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:00.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:00 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/1289320263' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:59:00.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:00 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:01.751 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:59:01.751 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:59:01.999 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:59:02.484 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 -- 172.21.15.189:0/2706617888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 msgr2=0x7f4a64106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:02.484 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 --2- 172.21.15.189:0/2706617888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 0x7f4a64106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009880 tx=0x7f4a5802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.484 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 -- 172.21.15.189:0/2706617888 shutdown_connections 2024-09-12T01:59:02.484 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 --2- 172.21.15.189:0/2706617888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 0x7f4a64106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 -- 172.21.15.189:0/2706617888 >> 172.21.15.189:0/2706617888 conn(0x7f4a640fc220 msgr2=0x7f4a640fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:02.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 -- 172.21.15.189:0/2706617888 shutdown_connections 2024-09-12T01:59:02.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 -- 172.21.15.189:0/2706617888 wait complete. 2024-09-12T01:59:02.488 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 Processor -- start 2024-09-12T01:59:02.488 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.480+0000 7f4a6abe2640 1 -- start start 2024-09-12T01:59:02.489 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6abe2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 0x7f4a641962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:02.489 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6abe2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 0x7f4a6419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:02.489 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6abe2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6410ac60 con 0x7f4a64106630 2024-09-12T01:59:02.489 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6abe2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6410aae0 con 0x7f4a64196820 2024-09-12T01:59:02.489 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a63fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 0x7f4a6419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:02.489 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a63fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 0x7f4a6419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:59434/0 (socket says 172.21.15.189:59434) 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a63fff640 1 -- 172.21.15.189:0/3701223757 learned_addr learned my addr 172.21.15.189:0/3701223757 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6897e640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 0x7f4a641962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a63fff640 1 -- 172.21.15.189:0/3701223757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 msgr2=0x7f4a6419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a63fff640 1 -- 172.21.15.189:0/3701223757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 msgr2=0x7f4a6419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a63fff640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 0x7f4a6419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a63fff640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 0x7f4a6419abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6897e640 1 -- 172.21.15.189:0/3701223757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 msgr2=0x7f4a6419abb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6897e640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 0x7f4a6419abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.490 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6897e640 1 -- 172.21.15.189:0/3701223757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a64196e40 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.481+0000 7f4a6897e640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 0x7f4a641962e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005ab0 tx=0x7f4a58032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.482+0000 7f4a61ffb640 1 -- 172.21.15.189:0/3701223757 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4a58035070 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.482+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6419b0f0 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.482+0000 7f4a61ffb640 1 -- 172.21.15.189:0/3701223757 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a58032e40 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.482+0000 7f4a61ffb640 1 -- 172.21.15.189:0/3701223757 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4a5803bc10 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.482+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6419b5d0 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.483+0000 7f4a61ffb640 1 -- 172.21.15.189:0/3701223757 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f4a58042030 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.483+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a64101ca0 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.483+0000 7f4a61ffb640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a54038e50 0x7f4a5403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.483+0000 7f4a61ffb640 1 -- 172.21.15.189:0/3701223757 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4a58040070 con 0x7f4a64106630 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.483+0000 7f4a63fff640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a54038e50 0x7f4a5403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:02.491 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.484+0000 7f4a63fff640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a54038e50 0x7f4a5403b310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009100 tx=0x7f4a50008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:02.492 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.488+0000 7f4a61ffb640 1 -- 172.21.15.189:0/3701223757 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a5803b510 con 0x7f4a64106630 2024-09-12T01:59:02.716 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.716+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4a6419b8b0 con 0x7f4a64106630 2024-09-12T01:59:02.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.717+0000 7f4a61ffb640 1 -- 172.21.15.189:0/3701223757 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f4a5803bdb0 con 0x7f4a64106630 2024-09-12T01:59:02.717 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:59:02.717 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","modified":"2024-09-12T01:58:54.248321Z","created":"2024-09-12T01:57:34.038532Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:59:02.717 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-12T01:59:02.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a54038e50 msgr2=0x7f4a5403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:02.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a54038e50 0x7f4a5403b310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009100 tx=0x7f4a50008040 comp rx=0 tx=0).stop 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 msgr2=0x7f4a641962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 0x7f4a641962e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005ab0 tx=0x7f4a58032c50 comp rx=0 tx=0).stop 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 shutdown_connections 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a54038e50 0x7f4a5403b310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a64196820 0x7f4a6419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 --2- 172.21.15.189:0/3701223757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a64106630 0x7f4a641962e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.719+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 >> 172.21.15.189:0/3701223757 conn(0x7f4a640fc220 msgr2=0x7f4a640fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.720+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 shutdown_connections 2024-09-12T01:59:02.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:02.720+0000 7f4a6abe2640 1 -- 172.21.15.189:0/3701223757 wait complete. 2024-09-12T01:59:03.346 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:02 smithi117 systemd[1]: Started Ceph mon.b for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:59:04.290 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:59:04.290 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:59:04.544 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:59:08.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.019+0000 7f94ef68a640 1 -- 172.21.15.189:0/2337650118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d4003530 msgr2=0x7f94d40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.019+0000 7f94ef68a640 1 --2- 172.21.15.189:0/2337650118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d4003530 0x7f94d40059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94e8075a20 tx=0x7f94e402bce0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.019+0000 7f94ef68a640 1 -- 172.21.15.189:0/2337650118 shutdown_connections 2024-09-12T01:59:08.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.019+0000 7f94ef68a640 1 --2- 172.21.15.189:0/2337650118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94d4003530 0x7f94d40059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.019+0000 7f94ef68a640 1 -- 172.21.15.189:0/2337650118 >> 172.21.15.189:0/2337650118 conn(0x7f94e80fd320 msgr2=0x7f94e80ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.019+0000 7f94ef68a640 1 -- 172.21.15.189:0/2337650118 shutdown_connections 2024-09-12T01:59:08.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.019+0000 7f94ef68a640 1 -- 172.21.15.189:0/2337650118 wait complete. 2024-09-12T01:59:08.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.020+0000 7f94ef68a640 1 Processor -- start 2024-09-12T01:59:08.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.020+0000 7f94ef68a640 1 -- start start 2024-09-12T01:59:08.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ef68a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 0x7f94e81a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ef68a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94e81a3c60 0x7f94e819d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ef68a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 0x7f94e819e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ef68a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f94e810fd50 con 0x7f94e81a3c60 2024-09-12T01:59:08.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ef68a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f94e810fbd0 con 0x7f94e819de20 2024-09-12T01:59:08.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ef68a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f94e810fed0 con 0x7f94d4003530 2024-09-12T01:59:08.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ed426640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 0x7f94e81a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ed426640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 0x7f94e81a3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:57098/0 (socket says 172.21.15.189:57098) 2024-09-12T01:59:08.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ed426640 1 -- 172.21.15.189:0/74290525 learned_addr learned my addr 172.21.15.189:0/74290525 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:59:08.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ecc25640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94e81a3c60 0x7f94e819d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ed426640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 msgr2=0x7f94e81a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ed426640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 msgr2=0x7f94e81a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ed426640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 0x7f94e81a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94edc27640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 0x7f94e819e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ed426640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 0x7f94e81a3720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94edc27640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 msgr2=0x7f94e819e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94edc27640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 msgr2=0x7f94e819e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94edc27640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 0x7f94e819e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:59:08.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94edc27640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 0x7f94e819e2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.021+0000 7f94ecc25640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 msgr2=0x7f94e81a3720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94ecc25640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 0x7f94e81a3720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94ecc25640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 msgr2=0x7f94e819e2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94ecc25640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 0x7f94e819e2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94ecc25640 1 -- 172.21.15.189:0/74290525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e81aa5f0 con 0x7f94e81a3c60 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94ecc25640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94e81a3c60 0x7f94e819d8e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94d800b450 tx=0x7f94d800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94de7fc640 1 -- 172.21.15.189:0/74290525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8004230 con 0x7f94e81a3c60 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94de7fc640 1 -- 172.21.15.189:0/74290525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94d80043d0 con 0x7f94e81a3c60 2024-09-12T01:59:08.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e81aa820 con 0x7f94e81a3c60 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94de7fc640 1 -- 172.21.15.189:0/74290525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8003cb0 con 0x7f94e81a3c60 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.022+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e81aadb0 con 0x7f94e81a3c60 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.023+0000 7f94de7fc640 1 -- 172.21.15.189:0/74290525 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f94d800f050 con 0x7f94e81a3c60 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.023+0000 7f94de7fc640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f94cc0394f0 0x7f94cc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.023+0000 7f94de7fc640 1 -- 172.21.15.189:0/74290525 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f94d804bdf0 con 0x7f94e81a3c60 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.024+0000 7f94ed426640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f94cc0394f0 0x7f94cc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.024+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e81104b0 con 0x7f94e81a3c60 2024-09-12T01:59:08.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.024+0000 7f94ed426640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f94cc0394f0 0x7f94cc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94e4005940 tx=0x7f94e40058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.030 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.030+0000 7f94de7fc640 1 -- 172.21.15.189:0/74290525 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94d800d040 con 0x7f94e81a3c60 2024-09-12T01:59:08.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.275+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f94e81ab0a0 con 0x7f94e81a3c60 2024-09-12T01:59:08.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: mon.c calling monitor election 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: mon.a calling monitor election 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.276 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: monmap epoch 3 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: last_changed 2024-09-12T01:59:02.986651+0000 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: min_mon_release 19 (squid) 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: election_strategy: 1 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: fsmap 2024-09-12T01:59:08.277 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:59:08.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: mgrmap e13: x(active, since 46s) 2024-09-12T01:59:08.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: overall HEALTH_OK 2024-09-12T01:59:08.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.275+0000 7f94de7fc640 1 -- 172.21.15.189:0/74290525 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f94d8011d70 con 0x7f94e81a3c60 2024-09-12T01:59:08.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:59:08.279 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":3,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","modified":"2024-09-12T01:59:02.986651Z","created":"2024-09-12T01:57:34.038532Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 3 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f94cc0394f0 msgr2=0x7f94cc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f94cc0394f0 0x7f94cc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94e4005940 tx=0x7f94e40058b0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94e81a3c60 msgr2=0x7f94e819d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94e81a3c60 0x7f94e819d8e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94d800b450 tx=0x7f94d800b910 comp rx=0 tx=0).stop 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 shutdown_connections 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f94cc0394f0 0x7f94cc03b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e819de20 0x7f94e819e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94e81a3c60 0x7f94e819d8e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 --2- 172.21.15.189:0/74290525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94d4003530 0x7f94e81a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 >> 172.21.15.189:0/74290525 conn(0x7f94e80fd320 msgr2=0x7f94e8101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 shutdown_connections 2024-09-12T01:59:08.281 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:08.278+0000 7f94ef68a640 1 -- 172.21.15.189:0/74290525 wait complete. 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: mon.c calling monitor election 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: mon.a calling monitor election 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: monmap epoch 3 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: last_changed 2024-09-12T01:59:02.986651+0000 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: min_mon_release 19 (squid) 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: election_strategy: 1 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:59:08.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: fsmap 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: mgrmap e13: x(active, since 46s) 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: overall HEALTH_OK 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:08.885 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T01:59:08.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T01:59:09.140 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:09.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:09 smithi100 ceph-mon[31179]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:09.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:09.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:09 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/74290525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:59:09.261 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:09.261 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:09 smithi189 ceph-mon[35188]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:09.262 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:09.262 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:09 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/74290525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:59:09.262 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:09.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.570+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/3246360845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4107660 msgr2=0x7ff9b4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:09.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.570+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/3246360845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4107660 0x7ff9b4107a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009880 tx=0x7ff9a402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.570+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/3246360845 shutdown_connections 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.570+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/3246360845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4107660 0x7ff9b4107a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.570+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/3246360845 >> 172.21.15.100:0/3246360845 conn(0x7ff9b40fd2b0 msgr2=0x7ff9b40ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.570+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/3246360845 shutdown_connections 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.570+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/3246360845 wait complete. 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 Processor -- start 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 -- start start 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b4107660 0x7ff9b4197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4197880 0x7ff9b419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b419c150 0x7ff9b419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410bc20 con 0x7ff9b4197880 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410baa0 con 0x7ff9b419c150 2024-09-12T01:59:09.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9ba1dd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410bda0 con 0x7ff9b4107660 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9b2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4197880 0x7ff9b419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9b2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4197880 0x7ff9b419bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47272/0 (socket says 172.21.15.100:47272) 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9b2ffd640 1 -- 172.21.15.100:0/4205477507 learned_addr learned my addr 172.21.15.100:0/4205477507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.571+0000 7ff9b37fe640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b4107660 0x7ff9b4197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b2ffd640 1 -- 172.21.15.100:0/4205477507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b4107660 msgr2=0x7ff9b4197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b2ffd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b4107660 0x7ff9b4197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b2ffd640 1 -- 172.21.15.100:0/4205477507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b419c150 msgr2=0x7ff9b419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b2ffd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b419c150 0x7ff9b419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b2ffd640 1 -- 172.21.15.100:0/4205477507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b41a3ec0 con 0x7ff9b4197880 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b2ffd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4197880 0x7ff9b419bc10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800b520 tx=0x7ff9a800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b0ff9640 1 -- 172.21.15.100:0/4205477507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8004230 con 0x7ff9b4197880 2024-09-12T01:59:09.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b0ff9640 1 -- 172.21.15.100:0/4205477507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a80043d0 con 0x7ff9b4197880 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b41a40f0 con 0x7ff9b4197880 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9b0ff9640 1 -- 172.21.15.100:0/4205477507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8003d60 con 0x7ff9b4197880 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.572+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b41a4680 con 0x7ff9b4197880 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.573+0000 7ff9b0ff9640 1 -- 172.21.15.100:0/4205477507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ff9a800e070 con 0x7ff9b4197880 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.573+0000 7ff9b0ff9640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff99c0394f0 0x7ff99c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.573+0000 7ff9b0ff9640 1 -- 172.21.15.100:0/4205477507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff9a804ca90 con 0x7ff9b4197880 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.573+0000 7ff9b37fe640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff99c0394f0 0x7ff99c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.573+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b4107ac0 con 0x7ff9b4197880 2024-09-12T01:59:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.574+0000 7ff9b37fe640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff99c0394f0 0x7ff99c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009230 tx=0x7ff9a4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:09.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.578+0000 7ff9b0ff9640 1 -- 172.21.15.100:0/4205477507 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9a8014020 con 0x7ff9b4197880 2024-09-12T01:59:09.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.744+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff9b41a4970 con 0x7ff9b4197880 2024-09-12T01:59:09.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.745+0000 7ff9b0ff9640 1 -- 172.21.15.100:0/4205477507 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7ff9a800ed70 con 0x7ff9b4197880 2024-09-12T01:59:09.746 INFO:teuthology.orchestra.run.smithi100.stdout:# minimal ceph.conf for 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:09.746 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-12T01:59:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: mon_host = [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-12T01:59:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff99c0394f0 msgr2=0x7ff99c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff99c0394f0 0x7ff99c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009230 tx=0x7ff9a4005a40 comp rx=0 tx=0).stop 2024-09-12T01:59:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4197880 msgr2=0x7ff9b419bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4197880 0x7ff9b419bc10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800b520 tx=0x7ff9a800b9e0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 shutdown_connections 2024-09-12T01:59:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff99c0394f0 0x7ff99c03b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b419c150 0x7ff9b419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b4197880 0x7ff9b419bc10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 --2- 172.21.15.100:0/4205477507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b4107660 0x7ff9b4197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 >> 172.21.15.100:0/4205477507 conn(0x7ff9b40fd2b0 msgr2=0x7ff9b40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 shutdown_connections 2024-09-12T01:59:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:09.747+0000 7ff9ba1dd640 1 -- 172.21.15.100:0/4205477507 wait complete. 2024-09-12T01:59:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:59:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: mon.c calling monitor election 2024-09-12T01:59:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: mon.a calling monitor election 2024-09-12T01:59:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: monmap epoch 3 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:10.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: last_changed 2024-09-12T01:59:02.986651+0000 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: min_mon_release 19 (squid) 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: election_strategy: 1 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: fsmap 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: mgrmap e13: x(active, since 46s) 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: overall HEALTH_OK 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.403 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.403 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.403 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:10.403 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:10.403 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/74290525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:59:10.403 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:10.461 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T01:59:10.461 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:59:10.461 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:59:10.487 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:59:10.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:10.553 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:59:10.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:59:10.581 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:59:10.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:10.646 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:59:10.646 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:59:10.673 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:59:10.673 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:10.738 INFO:tasks.cephadm:Adding mgr.x on smithi100 2024-09-12T01:59:10.738 INFO:tasks.cephadm:Adding mgr.y on smithi117 2024-09-12T01:59:10.739 INFO:tasks.cephadm:Adding mgr.z on smithi189 2024-09-12T01:59:10.739 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi100=x;smithi117=y;smithi189=z' 2024-09-12T01:59:10.801 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: mon.b calling monitor election 2024-09-12T01:59:10.802 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:59:10.802 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T01:59:10.802 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:59:10.802 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:10.802 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: mon.b calling monitor election 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: mon.c calling monitor election 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: mon.a calling monitor election 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: monmap epoch 3 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: last_changed 2024-09-12T01:59:02.986651+0000 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: min_mon_release 19 (squid) 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: election_strategy: 1 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:59:10.803 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: fsmap 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: mgrmap e13: x(active, since 48s) 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: overall HEALTH_OK 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: Updating smithi100:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: Updating smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: Updating smithi117:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.804 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:10.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:10.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: mon.b calling monitor election 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: mon.b calling monitor election 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: mon.c calling monitor election 2024-09-12T01:59:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: mon.a calling monitor election 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: monmap epoch 3 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: last_changed 2024-09-12T01:59:02.986651+0000 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: min_mon_release 19 (squid) 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: election_strategy: 1 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: fsmap 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:59:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: mgrmap e13: x(active, since 48s) 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: overall HEALTH_OK 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: Updating smithi100:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: Updating smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: Updating smithi117:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:10.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:10.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:10.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: mon.b calling monitor election 2024-09-12T01:59:10.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:59:10.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: mon.b calling monitor election 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: mon.c calling monitor election 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: mon.a calling monitor election 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: monmap epoch 3 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: last_changed 2024-09-12T01:59:02.986651+0000 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: created 2024-09-12T01:57:34.038532+0000 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: min_mon_release 19 (squid) 2024-09-12T01:59:10.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: election_strategy: 1 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: fsmap 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: mgrmap e13: x(active, since 48s) 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: overall HEALTH_OK 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: Updating smithi100:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: Updating smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: Updating smithi117:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:10.903 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:11.014 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:59:11.459 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.459+0000 7f3fd72d1640 1 -- 172.21.15.189:0/2158691931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 msgr2=0x7f3fd0101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:11.459 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.459+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/2158691931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 0x7f3fd0101ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009880 tx=0x7f3fc402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.460 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.459+0000 7f3fd72d1640 1 -- 172.21.15.189:0/2158691931 shutdown_connections 2024-09-12T01:59:11.460 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.459+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/2158691931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 0x7f3fd0101ae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.460 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.459+0000 7f3fd72d1640 1 -- 172.21.15.189:0/2158691931 >> 172.21.15.189:0/2158691931 conn(0x7f3fd00fce90 msgr2=0x7f3fd00ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:11.460 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.459+0000 7f3fd72d1640 1 -- 172.21.15.189:0/2158691931 shutdown_connections 2024-09-12T01:59:11.460 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.459+0000 7f3fd72d1640 1 -- 172.21.15.189:0/2158691931 wait complete. 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 Processor -- start 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 -- start start 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 0x7f3fd0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd00745e0 0x7f3fd0074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fd0074fa0 0x7f3fd01a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01077d0 con 0x7f3fd01016e0 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0107650 con 0x7f3fd0074fa0 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.460+0000 7f3fd72d1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0107950 con 0x7f3fd00745e0 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd00745e0 0x7f3fd0074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd00745e0 0x7f3fd0074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:57110/0 (socket says 172.21.15.189:57110) 2024-09-12T01:59:11.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 -- 172.21.15.189:0/1045867955 learned_addr learned my addr 172.21.15.189:0/1045867955 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd506d640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 0x7f3fd0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd586e640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fd0074fa0 0x7f3fd01a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 -- 172.21.15.189:0/1045867955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fd0074fa0 msgr2=0x7f3fd01a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fd0074fa0 0x7f3fd01a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 -- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 msgr2=0x7f3fd0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 0x7f3fd0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 -- 172.21.15.189:0/1045867955 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01a15d0 con 0x7f3fd00745e0 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd586e640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fd0074fa0 0x7f3fd01a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd506d640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 0x7f3fd0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd486c640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd00745e0 0x7f3fd0074a60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00b520 tx=0x7f3fcc00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fc27fc640 1 -- 172.21.15.189:0/1045867955 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc004230 con 0x7f3fd00745e0 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd01a18c0 con 0x7f3fd00745e0 2024-09-12T01:59:11.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fc27fc640 1 -- 172.21.15.189:0/1045867955 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fcc0043d0 con 0x7f3fd00745e0 2024-09-12T01:59:11.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fc27fc640 1 -- 172.21.15.189:0/1045867955 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc003d60 con 0x7f3fd00745e0 2024-09-12T01:59:11.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.461+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd01a1e80 con 0x7f3fd00745e0 2024-09-12T01:59:11.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.462+0000 7f3fc27fc640 1 -- 172.21.15.189:0/1045867955 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f3fcc00e070 con 0x7f3fd00745e0 2024-09-12T01:59:11.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.462+0000 7f3fc27fc640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3fbc0394f0 0x7f3fbc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:11.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.462+0000 7f3fc27fc640 1 -- 172.21.15.189:0/1045867955 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3fcc04ba70 con 0x7f3fd00745e0 2024-09-12T01:59:11.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.462+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd0190590 con 0x7f3fd00745e0 2024-09-12T01:59:11.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.463+0000 7f3fd506d640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3fbc0394f0 0x7f3fbc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:11.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.463+0000 7f3fd506d640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3fbc0394f0 0x7f3fbc03b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009230 tx=0x7f3fc40315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:11.467 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.467+0000 7f3fc27fc640 1 -- 172.21.15.189:0/1045867955 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fcc014020 con 0x7f3fd00745e0 2024-09-12T01:59:11.643 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.644+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}) -- 0x7f3fd00626c0 con 0x7f3fbc0394f0 2024-09-12T01:59:11.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.648+0000 7f3fc27fc640 1 -- 172.21.15.189:0/1045867955 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3fd00626c0 con 0x7f3fbc0394f0 2024-09-12T01:59:11.648 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mgr update... 2024-09-12T01:59:11.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3fbc0394f0 msgr2=0x7f3fbc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:11.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3fbc0394f0 0x7f3fbc03b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009230 tx=0x7f3fc40315d0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd00745e0 msgr2=0x7f3fd0074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd00745e0 0x7f3fd0074a60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00b520 tx=0x7f3fcc00b9e0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 shutdown_connections 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3fbc0394f0 0x7f3fbc03b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fd0074fa0 0x7f3fd01a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd00745e0 0x7f3fd0074a60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 --2- 172.21.15.189:0/1045867955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd01016e0 0x7f3fd0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 >> 172.21.15.189:0/1045867955 conn(0x7f3fd00fce90 msgr2=0x7f3fd00fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.650+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 shutdown_connections 2024-09-12T01:59:11.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:59:11.651+0000 7f3fd72d1640 1 -- 172.21.15.189:0/1045867955 wait complete. 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: Reconfiguring daemon mon.a on smithi100 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:12.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: Reconfiguring daemon mon.a on smithi100 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:12.080 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: Reconfiguring daemon mon.a on smithi100 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:12.158 DEBUG:teuthology.orchestra.run.smithi117:mgr.y> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T01:59:12.160 DEBUG:teuthology.orchestra.run.smithi189:mgr.z> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T01:59:12.200 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T01:59:12.201 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:59:12.201 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:59:12.219 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:59:12.219 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-12T01:59:12.275 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:59:12.275 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:12.276 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T01:59:12.276 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:12.276 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:12.276 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:58:33.235089989 +0000 2024-09-12T01:59:12.276 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:54:16.821315550 +0000 2024-09-12T01:59:12.276 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:54:16.821315550 +0000 2024-09-12T01:59:12.276 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:54:16.821315550 +0000 2024-09-12T01:59:12.276 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:59:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:59:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:59:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000216921 s, 2.4 MB/s 2024-09-12T01:59:12.342 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:59:12.399 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-12T01:59:12.455 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:59:12.455 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T01:59:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:12.455 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:58:33.270089059 +0000 2024-09-12T01:59:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:54:17.145307040 +0000 2024-09-12T01:59:12.456 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:54:17.145307040 +0000 2024-09-12T01:59:12.456 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:54:17.145307040 +0000 2024-09-12T01:59:12.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:59:12.520 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:59:12.521 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:59:12.521 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000272557 s, 1.9 MB/s 2024-09-12T01:59:12.523 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:59:12.580 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-12T01:59:12.635 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:59:12.635 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:12.635 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T01:59:12.635 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:12.635 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:12.635 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:58:33.306088103 +0000 2024-09-12T01:59:12.636 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:54:17.498297768 +0000 2024-09-12T01:59:12.636 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:54:17.498297768 +0000 2024-09-12T01:59:12.636 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:54:17.498297768 +0000 2024-09-12T01:59:12.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:59:12.704 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:59:12.705 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:59:12.705 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000216956 s, 2.4 MB/s 2024-09-12T01:59:12.705 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:59:12.761 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-12T01:59:12.817 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:58:33.342087147 +0000 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:54:17.826289152 +0000 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:54:17.826289152 +0000 2024-09-12T01:59:12.818 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:54:17.826289152 +0000 2024-09-12T01:59:12.819 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:59:12.881 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:59:12.882 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:59:12.882 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000197965 s, 2.6 MB/s 2024-09-12T01:59:12.883 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:59:12.940 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T01:59:12.940 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:59:12.957 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:59:12.958 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-12T01:59:13.013 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 01:59:02.448146808 +0000 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 01:54:29.295822222 +0000 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 01:54:29.295822222 +0000 2024-09-12T01:59:13.014 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 01:54:29.295822222 +0000 2024-09-12T01:59:13.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: Reconfiguring daemon mon.b on smithi117 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: Saving service mgr spec with placement smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:13.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:13.077 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T01:59:13.077 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T01:59:13.077 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00021154 s, 2.4 MB/s 2024-09-12T01:59:13.079 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:59:13.135 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 01:59:02.449146788 +0000 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 01:54:29.628815421 +0000 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 01:54:29.628815421 +0000 2024-09-12T01:59:13.190 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 01:54:29.628815421 +0000 2024-09-12T01:59:13.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:59:13.245 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: Reconfiguring daemon mon.b on smithi117 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: Saving service mgr spec with placement smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:13.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:13.253 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T01:59:13.253 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T01:59:13.253 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000180804 s, 2.8 MB/s 2024-09-12T01:59:13.255 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:59:13.311 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-12T01:59:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:59:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: Reconfiguring daemon mon.b on smithi117 2024-09-12T01:59:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=x;smithi117=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: Saving service mgr spec with placement smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T01:59:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:13.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:59:13.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:59:13.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 01:59:02.449146788 +0000 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 01:54:29.951808826 +0000 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 01:54:29.951808826 +0000 2024-09-12T01:59:13.366 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 01:54:29.951808826 +0000 2024-09-12T01:59:13.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:59:13.431 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T01:59:13.431 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T01:59:13.431 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000218445 s, 2.3 MB/s 2024-09-12T01:59:13.432 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:59:13.489 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-12T01:59:13.543 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 01:59:02.449146788 +0000 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 01:54:30.262802475 +0000 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 01:54:30.262802475 +0000 2024-09-12T01:59:13.544 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 01:54:30.262802475 +0000 2024-09-12T01:59:13.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:59:13.607 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T01:59:13.607 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T01:59:13.607 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00020271 s, 2.5 MB/s 2024-09-12T01:59:13.609 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:59:13.668 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:59:13.668 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:59:13.685 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:59:13.686 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-12T01:59:13.740 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:58:53.490514247 +0000 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:54:27.706534697 +0000 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:54:27.706534697 +0000 2024-09-12T01:59:13.741 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:54:27.706534697 +0000 2024-09-12T01:59:13.742 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:59:13.805 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:59:13.805 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:59:13.805 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000277056 s, 1.8 MB/s 2024-09-12T01:59:13.806 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:59:13.863 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:58:53.491514227 +0000 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:54:28.036527980 +0000 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:54:28.036527980 +0000 2024-09-12T01:59:13.919 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:54:28.036527980 +0000 2024-09-12T01:59:13.920 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:59:13.982 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:59:13.982 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:59:13.983 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000190818 s, 2.7 MB/s 2024-09-12T01:59:13.983 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:59:14.040 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:58:53.491514227 +0000 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:54:28.373521121 +0000 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:54:28.373521121 +0000 2024-09-12T01:59:14.095 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:54:28.373521121 +0000 2024-09-12T01:59:14.096 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:59:14.159 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:59:14.159 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:59:14.159 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000196088 s, 2.6 MB/s 2024-09-12T01:59:14.160 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:59:14.216 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-12T01:59:14.234 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:13 smithi189 ceph-mon[35188]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:59:14.235 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:13 smithi189 ceph-mon[35188]: Reconfiguring daemon mon.c on smithi189 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:58:53.491514227 +0000 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:54:28.706514343 +0000 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:54:28.706514343 +0000 2024-09-12T01:59:14.250 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:54:28.706514343 +0000 2024-09-12T01:59:14.251 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:59:14.315 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:59:14.315 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:59:14.315 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000205985 s, 2.5 MB/s 2024-09-12T01:59:14.316 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:59:14.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:13 smithi100 ceph-mon[31179]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:59:14.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:13 smithi100 ceph-mon[31179]: Reconfiguring daemon mon.c on smithi189 2024-09-12T01:59:14.373 INFO:tasks.cephadm:Deploying osd.0 on smithi100 with /dev/vg_nvme/lv_4... 2024-09-12T01:59:14.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:59:14.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:13 smithi117 ceph-mon[35240]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:59:14.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:13 smithi117 ceph-mon[35240]: Reconfiguring daemon mon.c on smithi189 2024-09-12T01:59:14.620 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:59:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:59:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:15.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:16.242 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:15 smithi100 ceph-mon[31179]: Deploying daemon mgr.z on smithi189 2024-09-12T01:59:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:15 smithi189 ceph-mon[35188]: Deploying daemon mgr.z on smithi189 2024-09-12T01:59:16.343 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 podman[36978]: 2024-09-12 01:59:16.234926729 +0000 UTC m=+0.114372355 container create 49d5bf957f825227388c176f9e9854005647bca42e5a593f4958975acd086047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T01:59:16.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:16 smithi117 ceph-mon[35240]: Deploying daemon mgr.z on smithi189 2024-09-12T01:59:16.631 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 podman[36978]: 2024-09-12 01:59:16.504575154 +0000 UTC m=+0.384020793 container init 49d5bf957f825227388c176f9e9854005647bca42e5a593f4958975acd086047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:59:16.631 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 podman[36978]: 2024-09-12 01:59:16.507516647 +0000 UTC m=+0.386962281 container start 49d5bf957f825227388c176f9e9854005647bca42e5a593f4958975acd086047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:59:16.631 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 ceph-mgr[36997]: -- 172.21.15.189:0/2269970003 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7e83430e0 con 0x55e7e8320800 2024-09-12T01:59:16.631 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 bash[36978]: 49d5bf957f825227388c176f9e9854005647bca42e5a593f4958975acd086047 2024-09-12T01:59:16.631 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 systemd[1]: Started Ceph mgr.z for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:59:16.894 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:59:16.901 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:16.631+0000 7f5f5c77f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:59:16.901 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:16.691+0000 7f5f5c77f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:16.901 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:16.836+0000 7f5f5c77f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:59:16.901 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:16.901+0000 7f5f5c77f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:59:16.919 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-09-12T01:59:17.162 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:17.185 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:17.047+0000 7f5f5c77f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:17.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:17.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:17.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:59:17.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:17.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:17.282 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:17.282 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.282 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:17.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:59:17.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:17.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:17.323 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:17.498 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:17.185+0000 7f5f5c77f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:59:17.498 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:17.498+0000 7f5f5c77f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/4288459935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 msgr2=0x7f5d34104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/4288459935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34104af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009900 tx=0x7f5d3002a410 comp rx=0 tx=0).stop 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/4288459935 shutdown_connections 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/4288459935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34107960 0x7f5d34109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/4288459935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34105030 0x7f5d34107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/4288459935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34104af0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/4288459935 >> 172.21.15.100:0/4288459935 conn(0x7f5d340fc280 msgr2=0x7f5d340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/4288459935 shutdown_connections 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/4288459935 wait complete. 2024-09-12T01:59:17.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 Processor -- start 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.602+0000 7f5d3b8bd640 1 -- start start 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d3b8bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d3b8bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34105030 0x7f5d341006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d3b8bd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34107960 0x7f5d34100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d3b8bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410d900 con 0x7f5d34102700 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d3b8bd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410d780 con 0x7f5d34107960 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d3b8bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410da80 con 0x7f5d34105030 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34102060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60304/0 (socket says 172.21.15.100:60304) 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 -- 172.21.15.100:0/2858756481 learned_addr learned my addr 172.21.15.100:0/2858756481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d38e58640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34105030 0x7f5d341006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39e5a640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34107960 0x7f5d34100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 -- 172.21.15.100:0/2858756481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34105030 msgr2=0x7f5d341006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34105030 0x7f5d341006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 -- 172.21.15.100:0/2858756481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34107960 msgr2=0x7f5d34100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34107960 0x7f5d34100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 -- 172.21.15.100:0/2858756481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d341014b0 con 0x7f5d34102700 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39e5a640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34107960 0x7f5d34100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d39659640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34102060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009230 tx=0x7f5d30031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3003f030 con 0x7f5d34102700 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d341a20e0 con 0x7f5d34102700 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.603+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d30003ad0 con 0x7f5d34102700 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.604+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30035070 con 0x7f5d34102700 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.604+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d341a2610 con 0x7f5d34102700 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.604+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f5d30042030 con 0x7f5d34102700 2024-09-12T01:59:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.605+0000 7f5d2a7fc640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5d20039290 0x7f5d2003b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.605+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d340fdd70 con 0x7f5d34102700 2024-09-12T01:59:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.605+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5d3006c930 con 0x7f5d34102700 2024-09-12T01:59:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.605+0000 7f5d38e58640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5d20039290 0x7f5d2003b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.605+0000 7f5d38e58640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5d20039290 0x7f5d2003b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d34101de0 tx=0x7f5d24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.609+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d30030c30 con 0x7f5d34102700 2024-09-12T01:59:17.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:17.784+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5d34062630 con 0x7f5d20039290 2024-09-12T01:59:17.842 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:17.559+0000 7f5f5c77f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:59:17.843 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:17.741+0000 7f5f5c77f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:59:18.173 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:18 smithi117 ceph-mon[35240]: Deploying daemon mgr.y on smithi117 2024-09-12T01:59:18.173 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:18 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:59:18.173 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:18 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:59:18.173 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:18 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:18.271 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:18 smithi100 ceph-mon[31179]: Deploying daemon mgr.y on smithi117 2024-09-12T01:59:18.271 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:18 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:59:18.271 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:18 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:59:18.271 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:18 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:18.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:18 smithi189 ceph-mon[35188]: Deploying daemon mgr.y on smithi117 2024-09-12T01:59:18.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:18 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:59:18.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:18 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:59:18.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:18 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:18.545 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 systemd[1]: Starting Ceph mgr.y for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T01:59:18.838 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 podman[36596]: 2024-09-12 01:59:18.545580173 +0000 UTC m=+0.097560402 container create 7b22ae8802525e12b4c45c479a4c86f49b400ffce77d01548b295e648262a6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:59:18.839 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 podman[36596]: 2024-09-12 01:59:18.463638176 +0000 UTC m=+0.015618374 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:59:18.839 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 podman[36596]: 2024-09-12 01:59:18.756033503 +0000 UTC m=+0.308013686 container init 7b22ae8802525e12b4c45c479a4c86f49b400ffce77d01548b295e648262a6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:59:18.839 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 podman[36596]: 2024-09-12 01:59:18.759472341 +0000 UTC m=+0.311452527 container start 7b22ae8802525e12b4c45c479a4c86f49b400ffce77d01548b295e648262a6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:59:18.839 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 ceph-mgr[36615]: -- 172.21.15.117:0/3626129080 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558cb52d50e0 con 0x558cb52b2800 2024-09-12T01:59:18.839 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 bash[36596]: 7b22ae8802525e12b4c45c479a4c86f49b400ffce77d01548b295e648262a6a2 2024-09-12T01:59:19.013 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:18.618+0000 7f5f5c77f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:59:19.013 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:18.684+0000 7f5f5c77f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:59:19.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-mon[35240]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:19.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-mon[35240]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:19.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.114 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 systemd[1]: Started Ceph mgr.y for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T01:59:19.114 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:18.888+0000 7f18543ac040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:59:19.114 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:18 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:18.956+0000 7f18543ac040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:19.114 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:19.112+0000 7f18543ac040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:59:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:19 smithi100 ceph-mon[31179]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:19 smithi100 ceph-mon[31179]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-mon[35188]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-mon[35188]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:19.399 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:19.180+0000 7f18543ac040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:59:19.400 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:19.340+0000 7f18543ac040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:19.699 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:19.434+0000 7f5f5c77f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:59:19.699 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:19.551+0000 7f5f5c77f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:59:19.700 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:19.698+0000 7f5f5c77f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:19.746 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:19.489+0000 7f18543ac040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:59:19.987 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:19.764+0000 7f5f5c77f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:59:19.988 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:19.917+0000 7f5f5c77f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:59:19.988 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:19.986+0000 7f5f5c77f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:59:20.019 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:19.809+0000 7f18543ac040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:59:20.019 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:19 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:19.872+0000 7f18543ac040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:59:20.273 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:20 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:20.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:20.283 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:20.049+0000 7f5f5c77f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:59:20.283 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:20.216+0000 7f5f5c77f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:59:20.283 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:20.282+0000 7f5f5c77f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:59:20.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:20 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:20.400 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:20 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:20.065+0000 7f18543ac040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:59:20.546 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:20.348+0000 7f5f5c77f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:59:20.546 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:20.429+0000 7f5f5c77f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:20.547 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:20.487+0000 7f5f5c77f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:59:20.547 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:20.545+0000 7f5f5c77f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:59:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/913777539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b493f8bd-74b9-487f-a058-e4bb350868c3"}]: dispatch 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/913777539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b493f8bd-74b9-487f-a058-e4bb350868c3"}]': finished 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:21.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:21.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:21.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:21.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:21 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1650982591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:59:21.325 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:21.325 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/913777539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b493f8bd-74b9-487f-a058-e4bb350868c3"}]: dispatch 2024-09-12T01:59:21.325 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/913777539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b493f8bd-74b9-487f-a058-e4bb350868c3"}]': finished 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:21.326 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:21.327 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1650982591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:20 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:20.940+0000 7f18543ac040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:21.006+0000 7f18543ac040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/913777539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b493f8bd-74b9-487f-a058-e4bb350868c3"}]: dispatch 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/913777539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b493f8bd-74b9-487f-a058-e4bb350868c3"}]': finished 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:21.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1650982591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:59:21.593 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:59:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z[36993]: 2024-09-12T01:59:21.324+0000 7f5f5c77f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:59:21.967 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:21.713+0000 7f18543ac040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:59:21.967 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:21.827+0000 7f18543ac040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:59:21.967 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:21 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:21.966+0000 7f18543ac040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:22.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:22.060+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7f5d3003b460 con 0x7f5d34102700 2024-09-12T01:59:22.244 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.027+0000 7f18543ac040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:59:22.244 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.175+0000 7f18543ac040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:59:22.244 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.243+0000 7f18543ac040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: Reconfiguring daemon mgr.x on smithi100 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: Standby manager daemon z started 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:22.245 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:22.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:59:22.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: Reconfiguring daemon mgr.x on smithi100 2024-09-12T01:59:22.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: Standby manager daemon z started 2024-09-12T01:59:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:59:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:59:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:22.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:59:22.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: Reconfiguring daemon mgr.x on smithi100 2024-09-12T01:59:22.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: Standby manager daemon z started 2024-09-12T01:59:22.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:59:22.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:22.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:59:22.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.189:0/2482052389' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:22.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:22.523 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.302+0000 7f18543ac040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:59:22.523 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.457+0000 7f18543ac040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:59:22.523 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.522+0000 7f18543ac040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:59:22.785 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.587+0000 7f18543ac040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:59:22.785 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.668+0000 7f18543ac040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:22.786 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.727+0000 7f18543ac040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:59:22.786 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:22.784+0000 7f18543ac040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:59:23.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:23 smithi100 ceph-mon[31179]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:23.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:23 smithi100 ceph-mon[31179]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-12T01:59:23.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:59:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:23 smithi189 ceph-mon[35188]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:23 smithi189 ceph-mon[35188]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-12T01:59:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:59:23.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:23 smithi117 ceph-mon[35240]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:23 smithi117 ceph-mon[35240]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-12T01:59:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:59:23.900 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 01:59:23 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y[36611]: 2024-09-12T01:59:23.560+0000 7f18543ac040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:59:24.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:24.068+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f5d3003a3c0 con 0x7f5d34102700 2024-09-12T01:59:24.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:24 smithi100 ceph-mon[31179]: Standby manager daemon y started 2024-09-12T01:59:24.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:24 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:59:24.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:24 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:24.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:24 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:59:24.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:24 smithi100 ceph-mon[31179]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:24.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:24 smithi189 ceph-mon[35188]: Standby manager daemon y started 2024-09-12T01:59:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:24 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:59:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:24 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:24 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:59:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:24 smithi189 ceph-mon[35188]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:24 smithi117 ceph-mon[35240]: Standby manager daemon y started 2024-09-12T01:59:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:24 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:59:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:24 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:24 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:59:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:24 smithi117 ceph-mon[35240]: from='mgr.? 172.21.15.117:0/3847771290' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:25.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:25 smithi100 ceph-mon[31179]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:25.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:25 smithi100 ceph-mon[31179]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-12T01:59:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:59:25.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:25 smithi189 ceph-mon[35188]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:25.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:25 smithi189 ceph-mon[35188]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-12T01:59:25.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:59:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:25 smithi117 ceph-mon[35240]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:25 smithi117 ceph-mon[35240]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-12T01:59:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:59:27.216 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:27 smithi100 ceph-mon[31179]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:27.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:27 smithi189 ceph-mon[35188]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:27.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:27 smithi117 ceph-mon[35240]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:28.512 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.512 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.512 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:28.512 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:28.512 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:28.512 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.512 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:28 smithi100 ceph-mon[31179]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:28 smithi189 ceph-mon[35188]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:28.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:28 smithi117 ceph-mon[35240]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:29.929 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:59:29.929 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:30.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:59:30.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:30.149 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:59:30.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:30.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:30 smithi117 ceph-mon[35240]: Deploying daemon osd.0 on smithi100 2024-09-12T01:59:30.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:30 smithi117 ceph-mon[35240]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:30.956 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:30 smithi100 ceph-mon[31179]: Deploying daemon osd.0 on smithi100 2024-09-12T01:59:30.956 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:30 smithi100 ceph-mon[31179]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:31.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:30 smithi189 ceph-mon[35188]: Deploying daemon osd.0 on smithi100 2024-09-12T01:59:31.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:30 smithi189 ceph-mon[35188]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:33 smithi100 ceph-mon[31179]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:33.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:33 smithi189 ceph-mon[35188]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:33 smithi117 ceph-mon[35240]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:35.194 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:35 smithi100 ceph-mon[31179]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:35 smithi189 ceph-mon[35188]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:35.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:35 smithi117 ceph-mon[35240]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:36.275 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:36.275 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:36.276 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:36.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:36.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:36.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:36.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:36.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:36.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:37.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:37 smithi100 ceph-mon[31179]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:37 smithi189 ceph-mon[35188]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:37.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:37 smithi117 ceph-mon[35240]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:38 smithi100 ceph-mon[31179]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:38.842 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:38 smithi189 ceph-mon[35188]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:38.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:38.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:38.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:38.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:38 smithi117 ceph-mon[35240]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:40.006 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 0 on host 'smithi100' 2024-09-12T01:59:40.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.006+0000 7f5d2a7fc640 1 -- 172.21.15.100:0/2858756481 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5d34062630 con 0x7f5d20039290 2024-09-12T01:59:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.008+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5d20039290 msgr2=0x7f5d2003b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.008+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5d20039290 0x7f5d2003b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d34101de0 tx=0x7f5d24005f90 comp rx=0 tx=0).stop 2024-09-12T01:59:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.008+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 msgr2=0x7f5d34102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.008+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34102060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009230 tx=0x7f5d30031b60 comp rx=0 tx=0).stop 2024-09-12T01:59:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.008+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 shutdown_connections 2024-09-12T01:59:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.008+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5d20039290 0x7f5d2003b750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.008+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34107960 0x7f5d34100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.009+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d34105030 0x7f5d341006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.009+0000 7f5d3b8bd640 1 --2- 172.21.15.100:0/2858756481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d34102700 0x7f5d34102060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.009+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 >> 172.21.15.100:0/2858756481 conn(0x7f5d340fc280 msgr2=0x7f5d341030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:40.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.009+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 shutdown_connections 2024-09-12T01:59:40.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:59:40.009+0000 7f5d3b8bd640 1 -- 172.21.15.100:0/2858756481 wait complete. 2024-09-12T01:59:40.278 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:40.278 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:40.278 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:40.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:40.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:40.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:40.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:40.623 DEBUG:teuthology.orchestra.run.smithi100:osd.0> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T01:59:40.626 INFO:tasks.cephadm:Deploying osd.1 on smithi117 with /dev/vg_nvme/lv_4... 2024-09-12T01:59:40.626 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:59:40.865 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:59:41.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:41 smithi189 ceph-mon[35188]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:41.182 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:41 smithi100 ceph-mon[31179]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:41.300 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:41 smithi117 ceph-mon[35240]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:42.319 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 01:59:42 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0[45228]: 2024-09-12T01:59:42.102+0000 7f1bee7e5640 -1 osd.0 0 log_to_monitors true 2024-09-12T01:59:43.196 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T01:59:43.221 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_4 2024-09-12T01:59:43.277 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:43 smithi100 ceph-mon[31179]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:43.277 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:43 smithi100 ceph-mon[31179]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:59:43.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:43 smithi189 ceph-mon[35188]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:43.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:43 smithi189 ceph-mon[35188]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:59:43.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:43 smithi117 ceph-mon[35240]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:43.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:43 smithi117 ceph-mon[35240]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:59:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:59:43.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 -- 172.21.15.117:0/3782183356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff134104f90 msgr2=0x7ff134107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 --2- 172.21.15.117:0/3782183356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff134104f90 0x7ff134107380 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff128009900 tx=0x7ff12802a410 comp rx=0 tx=0).stop 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 -- 172.21.15.117:0/3782183356 shutdown_connections 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 --2- 172.21.15.117:0/3782183356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1341078c0 0x7ff134109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 --2- 172.21.15.117:0/3782183356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff134104f90 0x7ff134107380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 --2- 172.21.15.117:0/3782183356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff134102660 0x7ff134104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 -- 172.21.15.117:0/3782183356 >> 172.21.15.117:0/3782183356 conn(0x7ff1340fc280 msgr2=0x7ff1340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 -- 172.21.15.117:0/3782183356 shutdown_connections 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.923+0000 7ff138b18640 1 -- 172.21.15.117:0/3782183356 wait complete. 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 Processor -- start 2024-09-12T01:59:43.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 -- start start 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff134102660 0x7ff13419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff134104f90 0x7ff13419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1341078c0 0x7ff1341a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff13410d8c0 con 0x7ff134104f90 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff13410d740 con 0x7ff1341078c0 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff138b18640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff13410da40 con 0x7ff134102660 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.924+0000 7ff132d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1341078c0 0x7ff1341a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1341078c0 0x7ff1341a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42690/0 (socket says 172.21.15.117:42690) 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 -- 172.21.15.117:0/940879463 learned_addr learned my addr 172.21.15.117:0/940879463 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T01:59:43.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff131d9b640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff134104f90 0x7ff13419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff13259c640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff134102660 0x7ff13419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 -- 172.21.15.117:0/940879463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff134102660 msgr2=0x7ff13419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff134102660 0x7ff13419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 -- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff134104f90 msgr2=0x7ff13419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff134104f90 0x7ff13419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 -- 172.21.15.117:0/940879463 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1341a1e20 con 0x7ff1341078c0 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff13259c640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff134102660 0x7ff13419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff132d9d640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1341078c0 0x7ff1341a17b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009fd0 tx=0x7ff12c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff1237fe640 1 -- 172.21.15.117:0/940879463 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c017070 con 0x7ff1341078c0 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff1237fe640 1 -- 172.21.15.117:0/940879463 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff12c003e50 con 0x7ff1341078c0 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1341a2110 con 0x7ff1341078c0 2024-09-12T01:59:43.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff1237fe640 1 -- 172.21.15.117:0/940879463 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0106c0 con 0x7ff1341078c0 2024-09-12T01:59:43.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.925+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1341a25d0 con 0x7ff1341078c0 2024-09-12T01:59:43.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.927+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff134109410 con 0x7ff1341078c0 2024-09-12T01:59:43.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.927+0000 7ff1237fe640 1 -- 172.21.15.117:0/940879463 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7ff12c003970 con 0x7ff1341078c0 2024-09-12T01:59:43.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.928+0000 7ff1237fe640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff11c0a2b20 0x7ff11c0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:43.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.928+0000 7ff1237fe640 1 -- 172.21.15.117:0/940879463 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7ff12c0cd1f0 con 0x7ff1341078c0 2024-09-12T01:59:43.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.928+0000 7ff13259c640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff11c0a2b20 0x7ff11c0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:43.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.928+0000 7ff13259c640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff11c0a2b20 0x7ff11c0a4fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff124009930 tx=0x7ff124008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:43.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:43.932+0000 7ff1237fe640 1 -- 172.21.15.117:0/940879463 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff12c09bd50 con 0x7ff1341078c0 2024-09-12T01:59:44.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T01:59:44.113+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff134062630 con 0x7ff11c0a2b20 2024-09-12T01:59:44.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:59:44.113 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:44.114 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:44.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.320 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0[45228]: 2024-09-12T01:59:44.064+0000 7f1be9f45640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:59:44.320 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 01:59:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0[45228]: 2024-09-12T01:59:44.068+0000 7f1be657f640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:44.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:44.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T01:59:45.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi100 2024-09-12T01:59:45.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:59:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi100 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi100 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: from='osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:45.352 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:59:45.353 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:59:45.353 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:46.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:46 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T01:59:46.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:46 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T01:59:46.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:46.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:46 smithi100 ceph-mon[31179]: osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] boot 2024-09-12T01:59:46.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:46 smithi100 ceph-mon[31179]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:59:46.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:46.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:46 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T01:59:46.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:46 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T01:59:46.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:46.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:46 smithi189 ceph-mon[35188]: osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] boot 2024-09-12T01:59:46.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:46 smithi189 ceph-mon[35188]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:59:46.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:46.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:46 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T01:59:46.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:46 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T01:59:46.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:46.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:46 smithi117 ceph-mon[35240]: osd.0 [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] boot 2024-09-12T01:59:46.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:46 smithi117 ceph-mon[35240]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:59:46.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:47.149 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:47.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:59:47.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/2963344979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]: dispatch 2024-09-12T01:59:47.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]: dispatch 2024-09-12T01:59:47.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]': finished 2024-09-12T01:59:47.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:59:47.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:59:47.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:47 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/4188010044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/2963344979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]: dispatch 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]: dispatch 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]': finished 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:59:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:47 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/4188010044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:59:47.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:59:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:59:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/2963344979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]: dispatch 2024-09-12T01:59:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]: dispatch 2024-09-12T01:59:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d934f40-d17c-4cc0-bf73-2e7afa558fee"}]': finished 2024-09-12T01:59:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:59:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:59:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:47 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/4188010044' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:59:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:49 smithi189 ceph-mon[35188]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:49.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:49 smithi117 ceph-mon[35240]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:49.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:49 smithi100 ceph-mon[31179]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:51.334 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:51 smithi117 ceph-mon[35240]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:51.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:51 smithi189 ceph-mon[35188]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:51.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:51 smithi100 ceph-mon[31179]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:53.315 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:53 smithi117 ceph-mon[35240]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:53.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:53 smithi189 ceph-mon[35188]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:53.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:53 smithi100 ceph-mon[31179]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:55 smithi189 ceph-mon[35188]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:59:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:55 smithi117 ceph-mon[35240]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:59:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:55.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:55 smithi100 ceph-mon[31179]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:59:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:56.269 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:56 smithi117 ceph-mon[35240]: Deploying daemon osd.1 on smithi117 2024-09-12T01:59:56.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:56 smithi189 ceph-mon[35188]: Deploying daemon osd.1 on smithi117 2024-09-12T01:59:56.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:56 smithi100 ceph-mon[31179]: Deploying daemon osd.1 on smithi117 2024-09-12T01:59:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:57 smithi117 ceph-mon[35240]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:57.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:57 smithi100 ceph-mon[31179]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:57.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:57 smithi189 ceph-mon[35188]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:59.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 01:59:59 smithi100 ceph-mon[31179]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 01:59:59 smithi117 ceph-mon[35240]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:59:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:59:59 smithi189 ceph-mon[35188]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:00.300 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:00 smithi117 ceph-mon[35240]: overall HEALTH_OK 2024-09-12T02:00:00.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:00 smithi189 ceph-mon[35188]: overall HEALTH_OK 2024-09-12T02:00:00.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:00 smithi100 ceph-mon[31179]: overall HEALTH_OK 2024-09-12T02:00:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:01 smithi117 ceph-mon[35240]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:01.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:01 smithi100 ceph-mon[31179]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:01.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:01.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:01.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:01.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:01 smithi189 ceph-mon[35188]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:03 smithi117 ceph-mon[35240]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:03.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:03 smithi100 ceph-mon[31179]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:03 smithi189 ceph-mon[35188]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:04.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.092+0000 7ff1237fe640 1 -- 172.21.15.117:0/940879463 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff134062630 con 0x7ff11c0a2b20 2024-09-12T02:00:04.093 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 1 on host 'smithi117' 2024-09-12T02:00:04.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff11c0a2b20 msgr2=0x7ff11c0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:04.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff11c0a2b20 0x7ff11c0a4fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff124009930 tx=0x7ff124008040 comp rx=0 tx=0).stop 2024-09-12T02:00:04.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1341078c0 msgr2=0x7ff1341a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:04.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1341078c0 0x7ff1341a17b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009fd0 tx=0x7ff12c00b260 comp rx=0 tx=0).stop 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 shutdown_connections 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff11c0a2b20 0x7ff11c0a4fe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1341078c0 0x7ff1341a17b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff134104f90 0x7ff13419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 --2- 172.21.15.117:0/940879463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff134102660 0x7ff13419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 >> 172.21.15.117:0/940879463 conn(0x7ff1340fc280 msgr2=0x7ff134101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 shutdown_connections 2024-09-12T02:00:04.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:04.094+0000 7ff138b18640 1 -- 172.21.15.117:0/940879463 wait complete. 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:04.713 DEBUG:teuthology.orchestra.run.smithi117:osd.1> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T02:00:04.715 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-12T02:00:04.715 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:00:04.973 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:00:07.202 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:07 smithi117 ceph-mon[35240]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:07.202 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1[39701]: 2024-09-12T02:00:07.105+0000 7f35a44df640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:00:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:07 smithi100 ceph-mon[31179]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:07.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:07 smithi189 ceph-mon[35188]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:07.394 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:00:07.421 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-12T02:00:07.673 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:00:08.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 -- 172.21.15.189:0/3689797039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0102690 msgr2=0x7ff1a0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/3689797039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0102690 0x7ff1a0108f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff198009ca0 tx=0x7ff19802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 -- 172.21.15.189:0/3689797039 shutdown_connections 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/3689797039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0102690 0x7ff1a0108f20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/3689797039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a0101cd0 0x7ff1a0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/3689797039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1a0100ad0 0x7ff1a0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 -- 172.21.15.189:0/3689797039 >> 172.21.15.189:0/3689797039 conn(0x7ff1a00fc280 msgr2=0x7ff1a00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 -- 172.21.15.189:0/3689797039 shutdown_connections 2024-09-12T02:00:08.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.155+0000 7ff1a86c5640 1 -- 172.21.15.189:0/3689797039 wait complete. 2024-09-12T02:00:08.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.156+0000 7ff1a86c5640 1 Processor -- start 2024-09-12T02:00:08.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.156+0000 7ff1a86c5640 1 -- start start 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.156+0000 7ff1a86c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0100ad0 0x7ff1a0197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.156+0000 7ff1a86c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a0101cd0 0x7ff1a01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.156+0000 7ff1a86c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1a0102690 0x7ff1a019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.156+0000 7ff1a86c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a010c750 con 0x7ff1a0102690 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.156+0000 7ff1a86c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a010c5d0 con 0x7ff1a0101cd0 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a86c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a010c8d0 con 0x7ff1a0100ad0 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0100ad0 0x7ff1a0197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0100ad0 0x7ff1a0197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:57354/0 (socket says 172.21.15.189:57354) 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 -- 172.21.15.189:0/330271723 learned_addr learned my addr 172.21.15.189:0/330271723 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a5c60640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a0101cd0 0x7ff1a01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:08.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6c62640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1a0102690 0x7ff1a019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 -- 172.21.15.189:0/330271723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a0101cd0 msgr2=0x7ff1a01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a0101cd0 0x7ff1a01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 -- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1a0102690 msgr2=0x7ff1a019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1a0102690 0x7ff1a019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 -- 172.21.15.189:0/330271723 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a019fac0 con 0x7ff1a0100ad0 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a5c60640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a0101cd0 0x7ff1a01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a6461640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0100ad0 0x7ff1a0197e90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00d770 tx=0x7ff19c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1977fe640 1 -- 172.21.15.189:0/330271723 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c017070 con 0x7ff1a0100ad0 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1977fe640 1 -- 172.21.15.189:0/330271723 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff19c009c30 con 0x7ff1a0100ad0 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1977fe640 1 -- 172.21.15.189:0/330271723 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c003dd0 con 0x7ff1a0100ad0 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a019fdb0 con 0x7ff1a0100ad0 2024-09-12T02:00:08.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.157+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a01a0210 con 0x7ff1a0100ad0 2024-09-12T02:00:08.161 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.158+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a01a0440 con 0x7ff1a0100ad0 2024-09-12T02:00:08.161 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.160+0000 7ff1977fe640 1 -- 172.21.15.189:0/330271723 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7ff19c003f70 con 0x7ff1a0100ad0 2024-09-12T02:00:08.161 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.161+0000 7ff1977fe640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff18c0a2b20 0x7ff18c0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:08.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.161+0000 7ff1977fe640 1 -- 172.21.15.189:0/330271723 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7ff19c0cd000 con 0x7ff1a0100ad0 2024-09-12T02:00:08.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.161+0000 7ff1a5c60640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff18c0a2b20 0x7ff18c0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:08.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.162+0000 7ff1a5c60640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff18c0a2b20 0x7ff18c0a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1900058c0 tx=0x7ff190005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:08.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.165+0000 7ff1977fe640 1 -- 172.21.15.189:0/330271723 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff19c09b950 con 0x7ff1a0100ad0 2024-09-12T02:00:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:00:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:00:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:08.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:08.346+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff1a006a6b0 con 0x7ff18c0a2b20 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:09.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi117 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: from='osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:00:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:09.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi117 2024-09-12T02:00:09.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-12T02:00:09.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:09.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:00:09.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:00:09.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:09.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: from='osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:00:09.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:00:09.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:00:09.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:00:09.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi117 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: from='osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:00:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:10.150 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1[39701]: 2024-09-12T02:00:09.784+0000 7f359fc3f640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:00:10.150 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1[39701]: 2024-09-12T02:00:09.793+0000 7f3598271640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:00:10.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:10 smithi117 ceph-mon[35240]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:00:10.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:10 smithi117 ceph-mon[35240]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:00:10.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:10 smithi117 ceph-mon[35240]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:00:10.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:10.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:10.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:10 smithi117 ceph-mon[35240]: from='osd.1 ' entity='osd.1' 2024-09-12T02:00:10.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:10 smithi189 ceph-mon[35188]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:00:10.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:10 smithi189 ceph-mon[35188]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:00:10.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:10 smithi189 ceph-mon[35188]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:00:10.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:10.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:10.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:10 smithi189 ceph-mon[35188]: from='osd.1 ' entity='osd.1' 2024-09-12T02:00:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:10 smithi100 ceph-mon[31179]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:00:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:10 smithi100 ceph-mon[31179]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:00:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:10 smithi100 ceph-mon[31179]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:00:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:10 smithi100 ceph-mon[31179]: from='osd.1 ' entity='osd.1' 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/1132346659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]: dispatch 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]: dispatch 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]': finished 2024-09-12T02:00:11.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] boot 2024-09-12T02:00:11.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: osdmap e13: 3 total, 2 up, 3 in 2024-09-12T02:00:11.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:11.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:11.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:00:11.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/1132346659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]: dispatch 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]: dispatch 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]': finished 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] boot 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: osdmap e13: 3 total, 2 up, 3 in 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/1132346659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]: dispatch 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]: dispatch 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8dc133a-5014-4f6a-8f17-33a94f1f84f5"}]': finished 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: osd.1 [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] boot 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: osdmap e13: 3 total, 2 up, 3 in 2024-09-12T02:00:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:00:11.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:12.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:12 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/3804392385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:00:12.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:12 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/3804392385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:00:12.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:12 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/3804392385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:00:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:13 smithi100 ceph-mon[31179]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:13.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:13 smithi100 ceph-mon[31179]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T02:00:13.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:13 smithi189 ceph-mon[35188]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:13 smithi189 ceph-mon[35188]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T02:00:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:13 smithi117 ceph-mon[35240]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:13 smithi117 ceph-mon[35240]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T02:00:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:15 smithi100 ceph-mon[31179]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:15 smithi189 ceph-mon[35188]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:15 smithi117 ceph-mon[35240]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:17.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:17 smithi100 ceph-mon[31179]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:17 smithi189 ceph-mon[35188]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:17 smithi117 ceph-mon[35240]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:19 smithi100 ceph-mon[31179]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:00:19.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:19 smithi189 ceph-mon[35188]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:00:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:19 smithi117 ceph-mon[35240]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:00:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:20.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:20 smithi100 ceph-mon[31179]: Deploying daemon osd.2 on smithi189 2024-09-12T02:00:20.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:20 smithi189 ceph-mon[35188]: Deploying daemon osd.2 on smithi189 2024-09-12T02:00:20.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:20 smithi117 ceph-mon[35240]: Deploying daemon osd.2 on smithi189 2024-09-12T02:00:21.244 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:21 smithi189 ceph-mon[35188]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:21 smithi100 ceph-mon[31179]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:21.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:21 smithi117 ceph-mon[35240]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:23.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:23 smithi100 ceph-mon[31179]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:23 smithi189 ceph-mon[35188]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:23 smithi117 ceph-mon[35240]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:25.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:25 smithi100 ceph-mon[31179]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:25.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:25 smithi189 ceph-mon[35188]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:25 smithi117 ceph-mon[35240]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:26.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:26 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:26.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:26 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:26.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:26 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:26.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:26 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:26.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:26 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:26.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:26 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:26 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:26 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:26 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:27.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:27 smithi100 ceph-mon[31179]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:27.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:27 smithi189 ceph-mon[35188]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:27.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:27 smithi117 ceph-mon[35240]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:29.238 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.238 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:28 smithi189 ceph-mon[35188]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:29.238 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.238 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:29.239 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:29.239 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:28 smithi100 ceph-mon[31179]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:29.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:29.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:29.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:28 smithi117 ceph-mon[35240]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:29.539 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-09-12T02:00:29.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.538+0000 7ff1977fe640 1 -- 172.21.15.189:0/330271723 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff1a006a6b0 con 0x7ff18c0a2b20 2024-09-12T02:00:29.541 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff18c0a2b20 msgr2=0x7ff18c0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:29.541 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff18c0a2b20 0x7ff18c0a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1900058c0 tx=0x7ff190005850 comp rx=0 tx=0).stop 2024-09-12T02:00:29.541 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0100ad0 msgr2=0x7ff1a0197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:29.541 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0100ad0 0x7ff1a0197e90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00d770 tx=0x7ff19c00dc30 comp rx=0 tx=0).stop 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 shutdown_connections 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff18c0a2b20 0x7ff18c0a4fe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1a0102690 0x7ff1a019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a0101cd0 0x7ff1a01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 --2- 172.21.15.189:0/330271723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1a0100ad0 0x7ff1a0197e90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 >> 172.21.15.189:0/330271723 conn(0x7ff1a00fc280 msgr2=0x7ff1a0069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 shutdown_connections 2024-09-12T02:00:29.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:00:29.541+0000 7ff1a86c5640 1 -- 172.21.15.189:0/330271723 wait complete. 2024-09-12T02:00:30.208 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:30.209 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:30.209 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:30.237 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T02:00:30.242 INFO:tasks.cephadm:Deploying osd.3 on smithi100 with /dev/vg_nvme/lv_3... 2024-09-12T02:00:30.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:00:30.265 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:30.265 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:30.266 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:30.301 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:30.301 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:30.301 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:30.482 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:31.317 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:30 smithi117 ceph-mon[35240]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:31.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:30 smithi100 ceph-mon[31179]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:31.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:30 smithi189 ceph-mon[35188]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:31.760 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:31 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2[40180]: 2024-09-12T02:00:31.648+0000 7f0a15600640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:00:31.999 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:31 smithi100 ceph-mon[31179]: from='osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:00:31.999 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:31 smithi100 ceph-mon[31179]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:00:32.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:31 smithi189 ceph-mon[35188]: from='osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:00:32.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:31 smithi189 ceph-mon[35188]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:00:32.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:31 smithi117 ceph-mon[35240]: from='osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:00:32.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:31 smithi117 ceph-mon[35240]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:00:33.091 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:00:33.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-09-12T02:00:33.214 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2[40180]: 2024-09-12T02:00:32.977+0000 7f0a10d60640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:00:33.214 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2[40180]: 2024-09-12T02:00:32.982+0000 7f0a0d39a640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:00:33.214 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-mon[35188]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:33.214 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-mon[35188]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:00:33.214 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-mon[35188]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:00:33.215 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:33.215 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-mon[35188]: from='osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:00:33.215 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:32 smithi189 ceph-mon[35188]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:00:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:32 smithi100 ceph-mon[31179]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:32 smithi100 ceph-mon[31179]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:00:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:32 smithi100 ceph-mon[31179]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:00:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:32 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:32 smithi100 ceph-mon[31179]: from='osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:00:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:32 smithi100 ceph-mon[31179]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:00:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:32 smithi117 ceph-mon[35240]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:32 smithi117 ceph-mon[35240]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:00:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:32 smithi117 ceph-mon[35240]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:00:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:32 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:32 smithi117 ceph-mon[35240]: from='osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:00:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:32 smithi117 ceph-mon[35240]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:00:33.411 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 -- 172.21.15.100:0/3288148518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e01026d0 msgr2=0x7fa6e0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 --2- 172.21.15.100:0/3288148518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e01026d0 0x7fa6e0108f60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009ca0 tx=0x7fa6d802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 -- 172.21.15.100:0/3288148518 shutdown_connections 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 --2- 172.21.15.100:0/3288148518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e01026d0 0x7fa6e0108f60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 --2- 172.21.15.100:0/3288148518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e0101d10 0x7fa6e0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 --2- 172.21.15.100:0/3288148518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e0100b10 0x7fa6e0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 -- 172.21.15.100:0/3288148518 >> 172.21.15.100:0/3288148518 conn(0x7fa6e00fc2a0 msgr2=0x7fa6e00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:33.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 -- 172.21.15.100:0/3288148518 shutdown_connections 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.839+0000 7fa6e495c640 1 -- 172.21.15.100:0/3288148518 wait complete. 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 Processor -- start 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 -- start start 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e0100b10 0x7fa6e0197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e0101d10 0x7fa6e0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01026d0 0x7fa6e019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e010c7c0 con 0x7fa6e0101d10 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e010c640 con 0x7fa6e0100b10 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6e495c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e010c940 con 0x7fa6e01026d0 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6ddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e0101d10 0x7fa6e0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6ddd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e0101d10 0x7fa6e0198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44330/0 (socket says 172.21.15.100:44330) 2024-09-12T02:00:33.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.840+0000 7fa6ddd9b640 1 -- 172.21.15.100:0/872753933 learned_addr learned my addr 172.21.15.100:0/872753933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6ded9d640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01026d0 0x7fa6e019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6de59c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e0100b10 0x7fa6e0197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6ddd9b640 1 -- 172.21.15.100:0/872753933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01026d0 msgr2=0x7fa6e019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6ddd9b640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01026d0 0x7fa6e019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6ddd9b640 1 -- 172.21.15.100:0/872753933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e0100b10 msgr2=0x7fa6e0197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6ddd9b640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e0100b10 0x7fa6e0197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6ddd9b640 1 -- 172.21.15.100:0/872753933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e019fa70 con 0x7fa6e0101d10 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6de59c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e0100b10 0x7fa6e0197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6ddd9b640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e0101d10 0x7fa6e0198380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c890 tx=0x7fa6d400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4004220 con 0x7fa6e0101d10 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d40043c0 con 0x7fa6e0101d10 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e019fd60 con 0x7fa6e0101d10 2024-09-12T02:00:33.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40049e0 con 0x7fa6e0101d10 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.841+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e01a0260 con 0x7fa6e0101d10 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.842+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e01a04f0 con 0x7fa6e0101d10 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.843+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7fa6d40079b0 con 0x7fa6e0101d10 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.844+0000 7fa6cf7fe640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6c80a2ba0 0x7fa6c80a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.844+0000 7fa6de59c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6c80a2ba0 0x7fa6c80a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.844+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fa6d40cd940 con 0x7fa6e0101d10 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.844+0000 7fa6de59c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6c80a2ba0 0x7fa6c80a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0101b70 tx=0x7fa6d0005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:33.848+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6d4014030 con 0x7fa6e0101d10 2024-09-12T02:00:34.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:34.027+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa6e006aea0 con 0x7fa6c80a2ba0 2024-09-12T02:00:34.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:34.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:34.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:34.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:35.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:00:35.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi189 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] boot 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:00:35.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi189 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] boot 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T02:00:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:35.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:00:35.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:00:35.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:00:35.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:00:35.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:00:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:00:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi189 2024-09-12T02:00:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T02:00:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:00:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: osd.2 [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] boot 2024-09-12T02:00:35.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T02:00:35.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:00:35.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:00:35.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:00:35.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:00:35.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:00:35.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:36.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:00:36.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:36 smithi100 ceph-mon[31179]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:00:36.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:00:36.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:00:36.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:36 smithi189 ceph-mon[35188]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:00:36.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:00:36.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:00:36.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:36 smithi117 ceph-mon[35240]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:00:36.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:00:36.568 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49635]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:00:36.568 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49635]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:36.568 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:36.569 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49635]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:37.001 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49644]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:00:37.001 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49644]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:37.001 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:37.002 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:00:36 smithi100 sudo[49644]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:37.127 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:36 smithi117 sudo[43882]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:00:37.128 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:36 smithi117 sudo[43882]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:37.128 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:36 smithi117 sudo[43882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:37.128 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:36 smithi117 sudo[43882]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:37.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:37.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:00:37.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:00:37.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:00:37.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1459457768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4d57e9c-f48a-4a2d-a8ce-03a263a479a8"}]: dispatch 2024-09-12T02:00:37.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1459457768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4d57e9c-f48a-4a2d-a8ce-03a263a479a8"}]': finished 2024-09-12T02:00:37.128 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T02:00:37.129 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:37.129 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1459457768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4d57e9c-f48a-4a2d-a8ce-03a263a479a8"}]: dispatch 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1459457768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4d57e9c-f48a-4a2d-a8ce-03a263a479a8"}]': finished 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:37.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1459457768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4d57e9c-f48a-4a2d-a8ce-03a263a479a8"}]: dispatch 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1459457768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4d57e9c-f48a-4a2d-a8ce-03a263a479a8"}]': finished 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:37.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:37 smithi117 sudo[43885]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:00:37.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:37 smithi117 sudo[43885]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:37.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:37 smithi117 sudo[43885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:37.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:00:37 smithi117 sudo[43885]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:37.650 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44276]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:00:37.650 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:37.651 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:37.651 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44276]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:38.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44279]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:00:38.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44279]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:38.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:38.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:00:37 smithi189 sudo[44279]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:38.219 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 sudo[49721]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:00:38.219 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 sudo[49721]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:38.219 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 sudo[49721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:38.219 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:37 smithi100 sudo[49721]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:38.479 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1110899789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:00:38.479 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:38.480 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:38.480 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 ceph-mon[35188]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:38.480 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44282]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:00:38.480 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44282]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:38.480 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:38.480 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44282]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:38.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 sudo[49917]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:00:38.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 sudo[49917]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 sudo[49917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 sudo[49917]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1110899789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:00:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:38 smithi100 ceph-mon[31179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:38.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1110899789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:00:38.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:38.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:38.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 ceph-mon[35240]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44285]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:00:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44285]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:38.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:38 smithi189 sudo[44285]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:39.215 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 sudo[43888]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:00:39.215 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 sudo[43888]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:39.215 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 sudo[43888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:39.215 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:38 smithi117 sudo[43888]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:39.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:39.228+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa6d4097f60 con 0x7fa6e0101d10 2024-09-12T02:00:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: pgmap v78: 1 pgs: 1 active+clean; 257 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: Cluster is now healthy 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: pgmap v78: 1 pgs: 1 active+clean; 257 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:00:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: Cluster is now healthy 2024-09-12T02:00:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 sudo[43891]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:00:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 sudo[43891]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:00:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 sudo[43891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:00:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 sudo[43891]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:00:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: pgmap v78: 1 pgs: 1 active+clean; 257 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: Cluster is now healthy 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:00:39.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:00:40.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:40 smithi100 ceph-mon[31179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:40.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:40 smithi100 ceph-mon[31179]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:00:40.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:40 smithi100 ceph-mon[31179]: pgmap v79: 1 pgs: 1 active+clean; 257 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:40.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:40 smithi189 ceph-mon[35188]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:40 smithi189 ceph-mon[35188]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:00:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:40 smithi189 ceph-mon[35188]: pgmap v79: 1 pgs: 1 active+clean; 257 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:40 smithi117 ceph-mon[35240]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:00:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:40 smithi117 ceph-mon[35240]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:00:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:40 smithi117 ceph-mon[35240]: pgmap v79: 1 pgs: 1 active+clean; 257 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:43.262 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:43 smithi100 ceph-mon[31179]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 485 KiB/s wr, 41 op/s 2024-09-12T02:00:43.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:43 smithi189 ceph-mon[35188]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 485 KiB/s wr, 41 op/s 2024-09-12T02:00:43.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:43 smithi117 ceph-mon[35240]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 485 KiB/s wr, 41 op/s 2024-09-12T02:00:45.314 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:45 smithi100 ceph-mon[31179]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 356 KiB/s wr, 30 op/s 2024-09-12T02:00:45.314 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:00:45.314 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:45 smithi189 ceph-mon[35188]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 356 KiB/s wr, 30 op/s 2024-09-12T02:00:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:00:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:45 smithi117 ceph-mon[35240]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 356 KiB/s wr, 30 op/s 2024-09-12T02:00:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:00:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:46.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:46 smithi100 ceph-mon[31179]: Deploying daemon osd.3 on smithi100 2024-09-12T02:00:46.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:46 smithi189 ceph-mon[35188]: Deploying daemon osd.3 on smithi100 2024-09-12T02:00:46.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:46 smithi117 ceph-mon[35240]: Deploying daemon osd.3 on smithi100 2024-09-12T02:00:47.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:47 smithi100 ceph-mon[31179]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 281 KiB/s wr, 23 op/s 2024-09-12T02:00:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:47 smithi189 ceph-mon[35188]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 281 KiB/s wr, 23 op/s 2024-09-12T02:00:47.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:47 smithi117 ceph-mon[35240]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 281 KiB/s wr, 23 op/s 2024-09-12T02:00:49.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:49 smithi100 ceph-mon[31179]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 232 KiB/s wr, 19 op/s 2024-09-12T02:00:49.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:49 smithi189 ceph-mon[35188]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 232 KiB/s wr, 19 op/s 2024-09-12T02:00:49.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:49 smithi117 ceph-mon[35240]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 232 KiB/s wr, 19 op/s 2024-09-12T02:00:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:51 smithi100 ceph-mon[31179]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-09-12T02:00:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:51.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:51 smithi189 ceph-mon[35188]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-09-12T02:00:51.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:51.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:51.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:51.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:51 smithi117 ceph-mon[35240]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-09-12T02:00:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:53.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:53 smithi100 ceph-mon[31179]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-09-12T02:00:53.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:53 smithi189 ceph-mon[35188]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-09-12T02:00:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:53 smithi117 ceph-mon[35240]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-09-12T02:00:54.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:54 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:54 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:54 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:54 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:54 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:54 smithi100 ceph-mon[31179]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:54.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:54.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:54.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:54 smithi189 ceph-mon[35188]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:54.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.867+0000 7fa6cf7fe640 1 -- 172.21.15.100:0/872753933 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa6e006aea0 con 0x7fa6c80a2ba0 2024-09-12T02:00:54.867 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 3 on host 'smithi100' 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6c80a2ba0 msgr2=0x7fa6c80a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6c80a2ba0 0x7fa6c80a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0101b70 tx=0x7fa6d0005db0 comp rx=0 tx=0).stop 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e0101d10 msgr2=0x7fa6e0198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e0101d10 0x7fa6e0198380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c890 tx=0x7fa6d400cd50 comp rx=0 tx=0).stop 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 shutdown_connections 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6c80a2ba0 0x7fa6c80a5060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e01026d0 0x7fa6e019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6e0101d10 0x7fa6e0198380 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 --2- 172.21.15.100:0/872753933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e0100b10 0x7fa6e0197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 >> 172.21.15.100:0/872753933 conn(0x7fa6e00fc2a0 msgr2=0x7fa6e006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 shutdown_connections 2024-09-12T02:00:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:00:54.870+0000 7fa6e495c640 1 -- 172.21.15.100:0/872753933 wait complete. 2024-09-12T02:00:54.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:54 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:54 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:54 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:54.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:54 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:54.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:54 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:54.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:54 smithi117 ceph-mon[35240]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:55.481 DEBUG:teuthology.orchestra.run.smithi100:osd.3> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T02:00:55.483 INFO:tasks.cephadm:Deploying osd.4 on smithi117 with /dev/vg_nvme/lv_3... 2024-09-12T02:00:55.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:00:55.702 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:55.702 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:55.702 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:55.739 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:00:55.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:55.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:55.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:55.860 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:55.860 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:55.860 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:56.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:56 smithi100 ceph-mon[31179]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:56.842 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:56 smithi189 ceph-mon[35188]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:56.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:56 smithi117 ceph-mon[35240]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:57.512 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:00:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3[51680]: 2024-09-12T02:00:57.211+0000 7f3cb3949640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:00:57.806 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:57 smithi100 ceph-mon[31179]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:00:57.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:57 smithi189 ceph-mon[35188]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:00:57.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:57 smithi117 ceph-mon[35240]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:00:58.261 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:00:58.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_3 2024-09-12T02:00:58.544 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:00:58.799 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:00:58.799 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:00:58.799 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi100 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:58.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 -- 172.21.15.117:0/2240531971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c101bf0 msgr2=0x7f432c101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:59.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 --2- 172.21.15.117:0/2240531971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c101bf0 0x7f432c101ff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4320009900 tx=0x7f432002a410 comp rx=0 tx=0).stop 2024-09-12T02:00:59.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 -- 172.21.15.117:0/2240531971 shutdown_connections 2024-09-12T02:00:59.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 --2- 172.21.15.117:0/2240531971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f432c1037b0 0x7f432c10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:59.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 --2- 172.21.15.117:0/2240531971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c102df0 0x7f432c103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:59.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 --2- 172.21.15.117:0/2240531971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c101bf0 0x7f432c101ff0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 -- 172.21.15.117:0/2240531971 >> 172.21.15.117:0/2240531971 conn(0x7f432c0fd3c0 msgr2=0x7f432c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 -- 172.21.15.117:0/2240531971 shutdown_connections 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.011+0000 7f4332e79640 1 -- 172.21.15.117:0/2240531971 wait complete. 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 Processor -- start 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 -- start start 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c101bf0 0x7f432c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f432c102df0 0x7f432c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c1037b0 0x7f432c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f432c10d880 con 0x7f432c101bf0 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f432c10d700 con 0x7f432c1037b0 2024-09-12T02:00:59.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4332e79640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f432c10da00 con 0x7f432c102df0 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4331416640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c1037b0 0x7f432c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4330c15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c101bf0 0x7f432c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4330c15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c101bf0 0x7f432c197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.117:47070/0 (socket says 172.21.15.117:47070) 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4330c15640 1 -- 172.21.15.117:0/600596685 learned_addr learned my addr 172.21.15.117:0/600596685 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4331416640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c1037b0 0x7f432c19f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35180/0 (socket says 172.21.15.117:35180) 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f432bfff640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f432c102df0 0x7f432c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4331416640 1 -- 172.21.15.117:0/600596685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f432c102df0 msgr2=0x7f432c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4331416640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f432c102df0 0x7f432c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4331416640 1 -- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c101bf0 msgr2=0x7f432c197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4331416640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c101bf0 0x7f432c197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4331416640 1 -- 172.21.15.117:0/600596685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432c19fae0 con 0x7f432c1037b0 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f432bfff640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f432c102df0 0x7f432c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:00:59.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.012+0000 7f4330c15640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c101bf0 0x7f432c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:59.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.013+0000 7f4331416640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c1037b0 0x7f432c19f470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4324009d10 tx=0x7f4324007590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:59.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.013+0000 7f4329ffb640 1 -- 172.21.15.117:0/600596685 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324009e60 con 0x7f432c1037b0 2024-09-12T02:00:59.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.013+0000 7f4329ffb640 1 -- 172.21.15.117:0/600596685 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43240100d0 con 0x7f432c1037b0 2024-09-12T02:00:59.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.013+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432c074420 con 0x7f432c1037b0 2024-09-12T02:00:59.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.013+0000 7f4329ffb640 1 -- 172.21.15.117:0/600596685 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432400ed80 con 0x7f432c1037b0 2024-09-12T02:00:59.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.013+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432c074960 con 0x7f432c1037b0 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.014+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432c108fa0 con 0x7f432c1037b0 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.015+0000 7f4329ffb640 1 -- 172.21.15.117:0/600596685 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4324010280 con 0x7f432c1037b0 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.015+0000 7f4329ffb640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f431c0a2bb0 0x7f431c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.016+0000 7f4329ffb640 1 -- 172.21.15.117:0/600596685 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f43240d12e0 con 0x7f432c1037b0 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.016+0000 7f4330c15640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f431c0a2bb0 0x7f431c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.016+0000 7f4330c15640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f431c0a2bb0 0x7f431c0a5070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4320000c00 tx=0x7f43200046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:59.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.020+0000 7f4329ffb640 1 -- 172.21.15.117:0/600596685 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f432409f580 con 0x7f432c1037b0 2024-09-12T02:00:59.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:00:59.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi100 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:59.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:00:59.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:00:59.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:00:59.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:59.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:00:59.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi100 2024-09-12T02:00:59.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:59.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:00:59.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:00:59.201+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f432c062630 con 0x7f431c0a2bb0 2024-09-12T02:00:59.616 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3[51680]: 2024-09-12T02:00:59.350+0000 7f3caf0a9640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:00:59.616 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3[51680]: 2024-09-12T02:00:59.360+0000 7f3ca76db640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:00:59.830 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:00:59.830 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] boot 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T02:00:59.831 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:00:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:01:00.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] boot 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T02:01:00.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:00:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857]' entity='osd.3' 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: osd.3 [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] boot 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T02:01:00.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:00:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:01:00.790 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:00 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:01:00.790 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:00 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:01:00.791 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:00 smithi117 ceph-mon[35240]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:00.791 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:00 smithi117 ceph-mon[35240]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:00.791 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:00 smithi117 ceph-mon[35240]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T02:01:00.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:00 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:01:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:00 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:01:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:00 smithi100 ceph-mon[31179]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:00 smithi100 ceph-mon[31179]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:00.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:00 smithi100 ceph-mon[31179]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T02:01:00.994 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:00 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:01:00.994 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:00 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:01:00.994 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:00 smithi189 ceph-mon[35188]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:00.994 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:00 smithi189 ceph-mon[35188]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:00.995 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:00 smithi189 ceph-mon[35188]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T02:01:01.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:01 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/1481465331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]: dispatch 2024-09-12T02:01:01.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:01 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]: dispatch 2024-09-12T02:01:01.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:01 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]': finished 2024-09-12T02:01:01.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:01 smithi117 ceph-mon[35240]: osdmap e25: 5 total, 4 up, 5 in 2024-09-12T02:01:01.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:02.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:01 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/1481465331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]: dispatch 2024-09-12T02:01:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:01 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]: dispatch 2024-09-12T02:01:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:01 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]': finished 2024-09-12T02:01:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:01 smithi189 ceph-mon[35188]: osdmap e25: 5 total, 4 up, 5 in 2024-09-12T02:01:02.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:02.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:01 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/1481465331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]: dispatch 2024-09-12T02:01:02.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:01 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]: dispatch 2024-09-12T02:01:02.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:01 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ac3570-1a74-41a5-8499-f05ebb8dda78"}]': finished 2024-09-12T02:01:02.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:01 smithi100 ceph-mon[31179]: osdmap e25: 5 total, 4 up, 5 in 2024-09-12T02:01:02.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:03.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:02 smithi100 ceph-mon[31179]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T02:01:03.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:03.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:02 smithi100 ceph-mon[31179]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 519 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:03.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:02 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/1674549675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:03.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:02 smithi189 ceph-mon[35188]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T02:01:03.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:03.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:02 smithi189 ceph-mon[35188]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 519 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:03.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:02 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/1674549675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:03.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:02 smithi117 ceph-mon[35240]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T02:01:03.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:03.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:02 smithi117 ceph-mon[35240]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 519 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:03.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:02 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/1674549675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:04.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:03 smithi100 ceph-mon[31179]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:01:04.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:04.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:03 smithi189 ceph-mon[35188]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:01:04.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:04.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:03 smithi117 ceph-mon[35240]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:01:04.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:05.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:04 smithi100 ceph-mon[31179]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 519 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:05.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:04 smithi189 ceph-mon[35188]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 519 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:05.149 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:04 smithi117 ceph-mon[35240]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 519 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:07.153 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:07 smithi117 ceph-mon[35240]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:07 smithi100 ceph-mon[31179]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:07.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:07 smithi189 ceph-mon[35188]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:09.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:09 smithi100 ceph-mon[31179]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:01:09.325 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:09 smithi117 ceph-mon[35240]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:01:09.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:09 smithi189 ceph-mon[35188]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:01:11.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:11 smithi100 ceph-mon[31179]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-12T02:01:11.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:01:11.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:11 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:11.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:11 smithi100 ceph-mon[31179]: Deploying daemon osd.4 on smithi117 2024-09-12T02:01:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:11 smithi189 ceph-mon[35188]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-12T02:01:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:01:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:11 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:11 smithi189 ceph-mon[35188]: Deploying daemon osd.4 on smithi117 2024-09-12T02:01:11.351 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:11 smithi117 ceph-mon[35240]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-12T02:01:11.351 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:01:11.351 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:11 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:11.351 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:11 smithi117 ceph-mon[35240]: Deploying daemon osd.4 on smithi117 2024-09-12T02:01:13.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:13 smithi117 ceph-mon[35240]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:01:13.308 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:13 smithi189 ceph-mon[35188]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:01:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:13 smithi100 ceph-mon[31179]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:01:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:15 smithi117 ceph-mon[35240]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T02:01:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:15 smithi100 ceph-mon[31179]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T02:01:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:15 smithi189 ceph-mon[35188]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T02:01:17.300 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:17 smithi117 ceph-mon[35240]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:01:17.300 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:17.300 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:17.300 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:17.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:17 smithi100 ceph-mon[31179]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:01:17.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:17.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:17.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:17 smithi189 ceph-mon[35188]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:01:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:19 smithi100 ceph-mon[31179]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:01:19.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:19.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:19.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:19 smithi189 ceph-mon[35188]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:01:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:19 smithi117 ceph-mon[35240]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:01:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:19.806 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 4 on host 'smithi117' 2024-09-12T02:01:19.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.806+0000 7f4329ffb640 1 -- 172.21.15.117:0/600596685 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f432c062630 con 0x7f431c0a2bb0 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f431c0a2bb0 msgr2=0x7f431c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f431c0a2bb0 0x7f431c0a5070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4320000c00 tx=0x7f43200046c0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c1037b0 msgr2=0x7f432c19f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c1037b0 0x7f432c19f470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4324009d10 tx=0x7f4324007590 comp rx=0 tx=0).stop 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 shutdown_connections 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f431c0a2bb0 0x7f431c0a5070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c1037b0 0x7f432c19f470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f432c102df0 0x7f432c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 --2- 172.21.15.117:0/600596685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f432c101bf0 0x7f432c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 >> 172.21.15.117:0/600596685 conn(0x7f432c0fd3c0 msgr2=0x7f432c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:19.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 shutdown_connections 2024-09-12T02:01:19.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:01:19.809+0000 7f4332e79640 1 -- 172.21.15.117:0/600596685 wait complete. 2024-09-12T02:01:20.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:20 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:20.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:20 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:20.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:20 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:20.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:20 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:20.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:20 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:20.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:20 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:20.379 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:20 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:20.379 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:20 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:20.380 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:20 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:20.406 DEBUG:teuthology.orchestra.run.smithi117:osd.4> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T02:01:20.408 INFO:tasks.cephadm:Deploying osd.5 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-12T02:01:20.408 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:01:20.663 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:01:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:21 smithi100 ceph-mon[31179]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:21.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:21 smithi189 ceph-mon[35188]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:21.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:21 smithi117 ceph-mon[35240]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:22.650 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:01:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:01:22.375+0000 7f892942f640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:01:23.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:23 smithi189 ceph-mon[35188]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:23.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:23 smithi189 ceph-mon[35188]: from='osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:01:23.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:23 smithi189 ceph-mon[35188]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:01:23.153 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:01:23.179 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-12T02:01:23.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:23 smithi117 ceph-mon[35240]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:23 smithi117 ceph-mon[35240]: from='osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:01:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:23 smithi117 ceph-mon[35240]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:01:23.434 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:01:23.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:23 smithi100 ceph-mon[31179]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:23.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:23 smithi100 ceph-mon[31179]: from='osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:01:23.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:23 smithi100 ceph-mon[31179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:01:23.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4104310345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c1037c0 msgr2=0x7f7b9c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4104310345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c1037c0 0x7f7b9c10a050 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009ca0 tx=0x7f7b9402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4104310345 shutdown_connections 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4104310345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c1037c0 0x7f7b9c10a050 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4104310345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c102e00 0x7f7b9c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4104310345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9c101c00 0x7f7b9c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4104310345 >> 172.21.15.189:0/4104310345 conn(0x7f7b9c0fd390 msgr2=0x7f7b9c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4104310345 shutdown_connections 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.872+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4104310345 wait complete. 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 Processor -- start 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 -- start start 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c101c00 0x7f7b9c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9c102e00 0x7f7b9c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c1037c0 0x7f7b9c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c10d8e0 con 0x7f7b9c102e00 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c10d760 con 0x7f7b9c1037c0 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7ba0c4a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c10da60 con 0x7f7b9c101c00 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7b9a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c101c00 0x7f7b9c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7b9a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c101c00 0x7f7b9c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:52334/0 (socket says 172.21.15.189:52334) 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7b9a59c640 1 -- 172.21.15.189:0/4287083033 learned_addr learned my addr 172.21.15.189:0/4287083033 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7b99d9b640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9c102e00 0x7f7b9c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.873+0000 7f7b9ad9d640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c1037c0 0x7f7b9c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b9a59c640 1 -- 172.21.15.189:0/4287083033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c1037c0 msgr2=0x7f7b9c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b9a59c640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c1037c0 0x7f7b9c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b9a59c640 1 -- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9c102e00 msgr2=0x7f7b9c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b9a59c640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9c102e00 0x7f7b9c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b9a59c640 1 -- 172.21.15.189:0/4287083033 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c0753e0 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b99d9b640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9c102e00 0x7f7b9c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b9a59c640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c101c00 0x7f7b9c075f90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00c970 tx=0x7f7b8c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b8b7fe640 1 -- 172.21.15.189:0/4287083033 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c004220 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b8b7fe640 1 -- 172.21.15.189:0/4287083033 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b8c0043c0 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9c1a20b0 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7b8b7fe640 1 -- 172.21.15.189:0/4287083033 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00f450 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.874+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9c1a2640 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.875+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9c108fa0 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.877+0000 7f7b8b7fe640 1 -- 172.21.15.189:0/4287083033 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7b8c0079b0 con 0x7f7b9c101c00 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.877+0000 7f7b8b7fe640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7b840a2b80 0x7f7b840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:23.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.878+0000 7f7b8b7fe640 1 -- 172.21.15.189:0/4287083033 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3805+0+0 (secure 0 0 0) 0x7f7b8c0cdcf0 con 0x7f7b9c101c00 2024-09-12T02:01:23.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.878+0000 7f7b99d9b640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7b840a2b80 0x7f7b840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:23.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.878+0000 7f7b99d9b640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7b840a2b80 0x7f7b840a5040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c075d10 tx=0x7f7b90008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:23.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:23.882+0000 7f7b8b7fe640 1 -- 172.21.15.189:0/4287083033 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b8c014030 con 0x7f7b9c101c00 2024-09-12T02:01:24.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:24.063+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7b9c062630 con 0x7f7b840a2b80 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi117 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:24.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:24.400 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:01:24.088+0000 7f8924b8f640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:01:24.400 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:01:24.094+0000 7f89211c9640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:01:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:01:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:01:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:01:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:01:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi117 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:24.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:24.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi117 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:24.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:25 smithi117 ceph-mon[35240]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:25 smithi117 ceph-mon[35240]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:25 smithi117 ceph-mon[35240]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:01:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:25 smithi117 ceph-mon[35240]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:01:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:25.459 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:25 smithi189 ceph-mon[35188]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:25.459 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:25 smithi189 ceph-mon[35188]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:25.459 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:25 smithi189 ceph-mon[35188]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:01:25.459 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:25 smithi189 ceph-mon[35188]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:01:25.459 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:25.459 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:25.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:25 smithi100 ceph-mon[31179]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:25.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:25 smithi100 ceph-mon[31179]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:25.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:25 smithi100 ceph-mon[31179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:01:25.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:25 smithi100 ceph-mon[31179]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:01:25.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:25.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:26.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:26 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:01:26.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:26 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:01:26.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:26 smithi189 ceph-mon[35188]: osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] boot 2024-09-12T02:01:26.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:26 smithi189 ceph-mon[35188]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T02:01:26.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:26 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:26 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:01:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:26 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:01:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:26 smithi117 ceph-mon[35240]: osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] boot 2024-09-12T02:01:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:26 smithi117 ceph-mon[35240]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T02:01:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:26 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:26.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:26 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:01:26.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:26 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:01:26.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:26 smithi100 ceph-mon[31179]: osd.4 [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] boot 2024-09-12T02:01:26.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:26 smithi100 ceph-mon[31179]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T02:01:26.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:26 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/766090004' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]: dispatch 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]: dispatch 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]': finished 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:27 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/1481719583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T02:01:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/766090004' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]: dispatch 2024-09-12T02:01:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]: dispatch 2024-09-12T02:01:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]': finished 2024-09-12T02:01:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T02:01:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:27.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:27 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/1481719583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:27.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:01:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T02:01:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/766090004' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]: dispatch 2024-09-12T02:01:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]: dispatch 2024-09-12T02:01:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3a5c2d4-bcf3-4436-8bec-636f3afb33bb"}]': finished 2024-09-12T02:01:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T02:01:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:27 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/1481719583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:29.370 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:29 smithi100 ceph-mon[31179]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:29.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:29 smithi117 ceph-mon[35240]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:29 smithi189 ceph-mon[35188]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:31.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:31 smithi117 ceph-mon[35240]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:31.423 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:31 smithi189 ceph-mon[35188]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:31.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:31 smithi100 ceph-mon[31179]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:33.151 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:33 smithi189 ceph-mon[35188]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:33.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:33 smithi117 ceph-mon[35240]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:33.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:33 smithi100 ceph-mon[31179]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:35 smithi117 ceph-mon[35240]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:35 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:01:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:35 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:35 smithi117 ceph-mon[35240]: Deploying daemon osd.5 on smithi189 2024-09-12T02:01:35.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:35 smithi189 ceph-mon[35188]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:35.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:35 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:01:35.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:35 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:35.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:35 smithi189 ceph-mon[35188]: Deploying daemon osd.5 on smithi189 2024-09-12T02:01:35.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:35 smithi100 ceph-mon[31179]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:35.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:35 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:01:35.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:35 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:35.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:35 smithi100 ceph-mon[31179]: Deploying daemon osd.5 on smithi189 2024-09-12T02:01:37.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:37 smithi117 ceph-mon[35240]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:37.508 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:37 smithi189 ceph-mon[35188]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:37.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:37 smithi100 ceph-mon[31179]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:39 smithi117 ceph-mon[35240]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:39.467 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:39 smithi189 ceph-mon[35188]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:39 smithi100 ceph-mon[31179]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:41 smithi117 ceph-mon[35240]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:41 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:41 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:41 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:41.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:41 smithi189 ceph-mon[35188]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:41.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:41 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:41.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:41 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:41.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:41 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:41.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:41 smithi100 ceph-mon[31179]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:41.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:41 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:41.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:41 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:41.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:41 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:43.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:43 smithi189 ceph-mon[35188]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:43.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:43 smithi117 ceph-mon[35240]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:43.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:43 smithi100 ceph-mon[31179]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:44.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:44.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:44.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:44 smithi100 ceph-mon[31179]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:44 smithi189 ceph-mon[35188]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:44.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.639+0000 7f7b8b7fe640 1 -- 172.21.15.189:0/4287083033 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7b9c062630 con 0x7f7b840a2b80 2024-09-12T02:01:44.639 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 5 on host 'smithi189' 2024-09-12T02:01:44.641 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7b840a2b80 msgr2=0x7f7b840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:44.641 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7b840a2b80 0x7f7b840a5040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c075d10 tx=0x7f7b90008040 comp rx=0 tx=0).stop 2024-09-12T02:01:44.641 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c101c00 msgr2=0x7f7b9c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:44.641 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c101c00 0x7f7b9c075f90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00c970 tx=0x7f7b8c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 shutdown_connections 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7b840a2b80 0x7f7b840a5040 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b9c1037c0 0x7f7b9c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9c102e00 0x7f7b9c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 --2- 172.21.15.189:0/4287083033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b9c101c00 0x7f7b9c075f90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.641+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 >> 172.21.15.189:0/4287083033 conn(0x7f7b9c0fd390 msgr2=0x7f7b9c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.642+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 shutdown_connections 2024-09-12T02:01:44.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:01:44.642+0000 7f7ba0c4a640 1 -- 172.21.15.189:0/4287083033 wait complete. 2024-09-12T02:01:44.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:44.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:44.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:44.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:44 smithi117 ceph-mon[35240]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:45.366 DEBUG:teuthology.orchestra.run.smithi189:osd.5> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T02:01:45.369 INFO:tasks.cephadm:Deploying osd.6 on smithi100 with /dev/vg_nvme/lv_2... 2024-09-12T02:01:45.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:01:45.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:45.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:45.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:45.623 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:45.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:45.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:45.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:45.731 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:45.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:45.732 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:46.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:46 smithi189 ceph-mon[35188]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:46.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:46 smithi117 ceph-mon[35240]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:46.734 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:46 smithi100 ceph-mon[31179]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:47.001 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:01:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:01:46.680+0000 7fcb1c5b1640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:01:47.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:47 smithi189 ceph-mon[35188]: from='osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:01:47.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:47 smithi189 ceph-mon[35188]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:01:47.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:47 smithi117 ceph-mon[35240]: from='osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:01:47.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:47 smithi117 ceph-mon[35240]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:01:47.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:47 smithi100 ceph-mon[31179]: from='osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:01:47.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:47 smithi100 ceph-mon[31179]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:01:48.132 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:01:48.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-09-12T02:01:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:48.442 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:01:48.442 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:48.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:01:48.346+0000 7fcb17d11640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:01:48.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:01:48.352+0000 7fcb1434b640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:01:48.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:01:48.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T02:01:48.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:48.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:48.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:01:48.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:48.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:48.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 -- 172.21.15.100:0/3033401804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 msgr2=0x7f7058108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 --2- 172.21.15.100:0/3033401804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f7058108f60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7050009ca0 tx=0x7f705002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 -- 172.21.15.100:0/3033401804 shutdown_connections 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 --2- 172.21.15.100:0/3033401804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f7058108f60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 --2- 172.21.15.100:0/3033401804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7058101d10 0x7f7058102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 --2- 172.21.15.100:0/3033401804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7058100b10 0x7f7058100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 -- 172.21.15.100:0/3033401804 >> 172.21.15.100:0/3033401804 conn(0x7f70580fc2a0 msgr2=0x7f70580fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:48.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 -- 172.21.15.100:0/3033401804 shutdown_connections 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.800+0000 7f705d519640 1 -- 172.21.15.100:0/3033401804 wait complete. 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 Processor -- start 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 -- start start 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7058100b10 0x7f705806b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7058101d10 0x7f705819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f705819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f705810c810 con 0x7f70581026d0 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f705810c690 con 0x7f7058100b10 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f705d519640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f705810c990 con 0x7f7058101d10 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f70577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f705819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:48.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f70577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f705819f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33172/0 (socket says 172.21.15.100:33172) 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f70577fe640 1 -- 172.21.15.100:0/2414491462 learned_addr learned my addr 172.21.15.100:0/2414491462 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.801+0000 7f70567fc640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7058101d10 0x7f705819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f7056ffd640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7058100b10 0x7f705806b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f70577fe640 1 -- 172.21.15.100:0/2414491462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7058101d10 msgr2=0x7f705819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f70577fe640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7058101d10 0x7f705819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f70577fe640 1 -- 172.21.15.100:0/2414491462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7058100b10 msgr2=0x7f705806b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f70577fe640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7058100b10 0x7f705806b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f70577fe640 1 -- 172.21.15.100:0/2414491462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705819faa0 con 0x7f70581026d0 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f7056ffd640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7058100b10 0x7f705806b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f70577fe640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f705819f1e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70500098d0 tx=0x7f705002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f703ffff640 1 -- 172.21.15.100:0/2414491462 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705002fc30 con 0x7f70581026d0 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705819fd30 con 0x7f70581026d0 2024-09-12T02:01:48.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f703ffff640 1 -- 172.21.15.100:0/2414491462 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7050003e50 con 0x7f70581026d0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f703ffff640 1 -- 172.21.15.100:0/2414491462 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050004810 con 0x7f70581026d0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.802+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70581a0290 con 0x7f70581026d0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.803+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7058107e40 con 0x7f70581026d0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.804+0000 7f703ffff640 1 -- 172.21.15.100:0/2414491462 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7050003970 con 0x7f70581026d0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.805+0000 7f703ffff640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f70400a2b80 0x7f70400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.805+0000 7f7056ffd640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f70400a2b80 0x7f70400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.805+0000 7f703ffff640 1 -- 172.21.15.100:0/2414491462 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7f70500ef420 con 0x7f70581026d0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.805+0000 7f7056ffd640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f70400a2b80 0x7f70400a5040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f705806b870 tx=0x7f7048008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:48.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.809+0000 7f703ffff640 1 -- 172.21.15.100:0/2414491462 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70500bd480 con 0x7f70581026d0 2024-09-12T02:01:48.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:01:48.991+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7058062630 con 0x7f70400a2b80 2024-09-12T02:01:49.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi189 2024-09-12T02:01:49.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T02:01:49.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:01:49.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:01:49.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] boot 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T02:01:49.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.660 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi189 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] boot 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T02:01:49.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi189 2024-09-12T02:01:49.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T02:01:49.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:01:49.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:01:49.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: osd.5 [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] boot 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T02:01:49.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:01:50.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:50 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:01:50.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:50 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:01:50.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:50 smithi117 ceph-mon[35240]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:50.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:50 smithi117 ceph-mon[35240]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T02:01:50.692 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:50 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:01:50.692 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:50 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:01:50.692 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:50 smithi100 ceph-mon[31179]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:50.692 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:50 smithi100 ceph-mon[31179]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T02:01:50.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:50 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:01:50.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:50 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:01:50.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:50 smithi189 ceph-mon[35188]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:50.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:50 smithi189 ceph-mon[35188]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T02:01:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:52 smithi117 ceph-mon[35240]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:01:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:52 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3256277925' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff037492-9e8b-4d22-9ba3-6037e1a6768f"}]: dispatch 2024-09-12T02:01:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:52 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3256277925' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff037492-9e8b-4d22-9ba3-6037e1a6768f"}]': finished 2024-09-12T02:01:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:52 smithi117 ceph-mon[35240]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T02:01:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:01:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:52 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/478332130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:52 smithi117 ceph-mon[35240]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:52.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:52 smithi100 ceph-mon[31179]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:01:52.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:52 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3256277925' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff037492-9e8b-4d22-9ba3-6037e1a6768f"}]: dispatch 2024-09-12T02:01:52.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:52 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3256277925' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff037492-9e8b-4d22-9ba3-6037e1a6768f"}]': finished 2024-09-12T02:01:52.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:52 smithi100 ceph-mon[31179]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T02:01:52.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:01:52.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:52 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/478332130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:52.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:52 smithi100 ceph-mon[31179]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:52.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:52 smithi189 ceph-mon[35188]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:01:52.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:52 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3256277925' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff037492-9e8b-4d22-9ba3-6037e1a6768f"}]: dispatch 2024-09-12T02:01:52.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:52 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3256277925' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff037492-9e8b-4d22-9ba3-6037e1a6768f"}]': finished 2024-09-12T02:01:52.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:52 smithi189 ceph-mon[35188]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T02:01:52.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:01:52.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:52 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/478332130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:01:52.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:52 smithi189 ceph-mon[35188]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:53.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:53 smithi100 ceph-mon[31179]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T02:01:53.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:53 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:01:53.842 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:53 smithi189 ceph-mon[35188]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T02:01:53.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:53 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:01:53.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:53 smithi117 ceph-mon[35240]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T02:01:53.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:53 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:01:54.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:54 smithi100 ceph-mon[31179]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:54.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:54 smithi189 ceph-mon[35188]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:54.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:54 smithi117 ceph-mon[35240]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:57.123 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:57 smithi100 ceph-mon[31179]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:57.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:57 smithi189 ceph-mon[35188]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:57 smithi117 ceph-mon[35240]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:01:59.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:01:59 smithi100 ceph-mon[31179]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T02:01:59.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:01:59 smithi189 ceph-mon[35188]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T02:01:59.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:01:59 smithi117 ceph-mon[35240]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T02:02:00.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:00 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:02:00.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:00 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:00.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:00 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:02:00.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:00 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:00.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:00 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:02:00.788 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:00 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:01.301 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:01 smithi117 ceph-mon[35240]: Deploying daemon osd.6 on smithi100 2024-09-12T02:02:01.301 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:01 smithi117 ceph-mon[35240]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T02:02:01.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:01 smithi100 ceph-mon[31179]: Deploying daemon osd.6 on smithi100 2024-09-12T02:02:01.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:01 smithi100 ceph-mon[31179]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T02:02:01.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:01 smithi189 ceph-mon[35188]: Deploying daemon osd.6 on smithi100 2024-09-12T02:02:01.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:01 smithi189 ceph-mon[35188]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T02:02:03.211 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:03 smithi100 ceph-mon[31179]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:02:03.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:03 smithi189 ceph-mon[35188]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:02:03.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:03 smithi117 ceph-mon[35240]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:02:05.127 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:05 smithi100 ceph-mon[31179]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:02:05.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:05 smithi189 ceph-mon[35188]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:02:05.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:05 smithi117 ceph-mon[35240]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:02:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:06 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:06 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:06 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:06.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:06 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:06.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:06 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:06.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:06 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:06.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:06 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:06.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:06 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:06.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:06 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:07.313 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:07 smithi100 ceph-mon[31179]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:02:07.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:07 smithi189 ceph-mon[35188]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:02:07.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:07 smithi117 ceph-mon[35240]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:02:08.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.745+0000 7f703ffff640 1 -- 172.21.15.100:0/2414491462 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7058062630 con 0x7f70400a2b80 2024-09-12T02:02:08.746 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 6 on host 'smithi100' 2024-09-12T02:02:08.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f70400a2b80 msgr2=0x7f70400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f70400a2b80 0x7f70400a5040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f705806b870 tx=0x7f7048008040 comp rx=0 tx=0).stop 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 msgr2=0x7f705819f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f705819f1e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70500098d0 tx=0x7f705002f840 comp rx=0 tx=0).stop 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 shutdown_connections 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f70400a2b80 0x7f70400a5040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70581026d0 0x7f705819f1e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7058101d10 0x7f705819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 --2- 172.21.15.100:0/2414491462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7058100b10 0x7f705806b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 >> 172.21.15.100:0/2414491462 conn(0x7f70580fc2a0 msgr2=0x7f7058105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 shutdown_connections 2024-09-12T02:02:08.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:02:08.748+0000 7f705d519640 1 -- 172.21.15.100:0/2414491462 wait complete. 2024-09-12T02:02:09.281 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:09 smithi100 ceph-mon[31179]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:02:09.281 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:09.281 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:09 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:09.307 DEBUG:teuthology.orchestra.run.smithi100:osd.6> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T02:02:09.309 INFO:tasks.cephadm:Deploying osd.7 on smithi117 with /dev/vg_nvme/lv_2... 2024-09-12T02:02:09.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:02:09.337 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:09 smithi117 ceph-mon[35240]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:02:09.337 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:09.337 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:09 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:09.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:09 smithi189 ceph-mon[35188]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:02:09.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:09.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:09 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:09.565 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:02:10.794 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:10.794 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:10.794 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:10 smithi117 ceph-mon[35240]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:10.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:10.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:10.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:10 smithi100 ceph-mon[31179]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:10.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:10.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:10.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:10 smithi189 ceph-mon[35188]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:12.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:11 smithi100 ceph-mon[31179]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:02:12.069 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:02:11 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:02:11.818+0000 7f0a093ad640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:02:12.083 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:11 smithi117 ceph-mon[35240]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:02:12.085 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:02:12.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_2 2024-09-12T02:02:12.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:11 smithi189 ceph-mon[35188]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:02:12.395 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 -- 172.21.15.117:0/401313796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 msgr2=0x7f5908105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 --2- 172.21.15.117:0/401313796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f5908105c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5900009ca0 tx=0x7f590002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 -- 172.21.15.117:0/401313796 shutdown_connections 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 --2- 172.21.15.117:0/401313796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f5908105c40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 --2- 172.21.15.117:0/401313796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5908102de0 0x7f5908105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 --2- 172.21.15.117:0/401313796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908100490 0x7f59081028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 -- 172.21.15.117:0/401313796 >> 172.21.15.117:0/401313796 conn(0x7f59080fc2a0 msgr2=0x7f59080fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:12.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 -- 172.21.15.117:0/401313796 shutdown_connections 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.851+0000 7f590f3ae640 1 -- 172.21.15.117:0/401313796 wait complete. 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 Processor -- start 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 -- start start 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908100490 0x7f590819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5908102de0 0x7f590819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f59081a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5908113ea0 con 0x7f5908102de0 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5908113d20 con 0x7f5908105790 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590f3ae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5908114020 con 0x7f5908100490 2024-09-12T02:02:12.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d94b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f59081a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d14a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908100490 0x7f590819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590c949640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5908102de0 0x7f590819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d14a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908100490 0x7f590819e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.117:50540/0 (socket says 172.21.15.117:50540) 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d94b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f59081a5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:41620/0 (socket says 172.21.15.117:41620) 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590c949640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5908102de0 0x7f590819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.117:48062/0 (socket says 172.21.15.117:48062) 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d14a640 1 -- 172.21.15.117:0/2946962851 learned_addr learned my addr 172.21.15.117:0/2946962851 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d94b640 1 -- 172.21.15.117:0/2946962851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908100490 msgr2=0x7f590819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d94b640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908100490 0x7f590819e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d94b640 1 -- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5908102de0 msgr2=0x7f590819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d94b640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5908102de0 0x7f590819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.852+0000 7f590d94b640 1 -- 172.21.15.117:0/2946962851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59081a60a0 con 0x7f5908105790 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.853+0000 7f590d94b640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f59081a5a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5900031ae0 tx=0x7f5900031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.853+0000 7f58fa7fc640 1 -- 172.21.15.117:0/2946962851 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900003c30 con 0x7f5908105790 2024-09-12T02:02:12.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.853+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59081a6330 con 0x7f5908105790 2024-09-12T02:02:12.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.853+0000 7f58fa7fc640 1 -- 172.21.15.117:0/2946962851 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5900003dd0 con 0x7f5908105790 2024-09-12T02:02:12.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.853+0000 7f58fa7fc640 1 -- 172.21.15.117:0/2946962851 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590002fd40 con 0x7f5908105790 2024-09-12T02:02:12.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.853+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59081a6890 con 0x7f5908105790 2024-09-12T02:02:12.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.854+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59080fdd90 con 0x7f5908105790 2024-09-12T02:02:12.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.855+0000 7f58fa7fc640 1 -- 172.21.15.117:0/2946962851 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5900004050 con 0x7f5908105790 2024-09-12T02:02:12.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.856+0000 7f58fa7fc640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f58f40a2bb0 0x7f58f40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:12.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.856+0000 7f58fa7fc640 1 -- 172.21.15.117:0/2946962851 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4669+0+0 (secure 0 0 0) 0x7f59000ef2f0 con 0x7f5908105790 2024-09-12T02:02:12.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.856+0000 7f590d14a640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f58f40a2bb0 0x7f58f40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:12.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.856+0000 7f590d14a640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f58f40a2bb0 0x7f58f40a5070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00bca0 tx=0x7f58fc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:12.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:12.860+0000 7f58fa7fc640 1 -- 172.21.15.117:0/2946962851 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59000bd090 con 0x7f5908105790 2024-09-12T02:02:13.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:13.036+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5908062630 con 0x7f58f40a2bb0 2024-09-12T02:02:13.036 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:02:13.036 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.037 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:13.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:13.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:13.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:02:13.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:02:13.038 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:13.068 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:02:12.881+0000 7f0a04b0d640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:02:13.068 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:02:12.892+0000 7f0a01147640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:02:13.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:02:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:02:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:02:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:13.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:13.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:02:13.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:02:13.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi100 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:14.075 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:14.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi100 2024-09-12T02:02:14.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T02:02:14.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:14.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:02:14.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:02:14.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:02:14.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:14.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi100 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:14 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:02:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:14 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:02:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:14 smithi117 ceph-mon[35240]: osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] boot 2024-09-12T02:02:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:14 smithi117 ceph-mon[35240]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T02:02:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:14 smithi117 ceph-mon[35240]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:14 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:02:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:14 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:02:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:14 smithi100 ceph-mon[31179]: osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] boot 2024-09-12T02:02:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:14 smithi100 ceph-mon[31179]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T02:02:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:14 smithi100 ceph-mon[31179]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:14 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:02:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:14 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:02:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:14 smithi189 ceph-mon[35188]: osd.6 [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] boot 2024-09-12T02:02:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:14 smithi189 ceph-mon[35188]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T02:02:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:02:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:14 smithi189 ceph-mon[35188]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:02:16.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:15 smithi117 ceph-mon[35240]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T02:02:16.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:15 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/3623278524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]: dispatch 2024-09-12T02:02:16.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:15 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]: dispatch 2024-09-12T02:02:16.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:15 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]': finished 2024-09-12T02:02:16.151 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:15 smithi117 ceph-mon[35240]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T02:02:16.151 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:16.151 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:15 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/2045538166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:02:16.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:15 smithi100 ceph-mon[31179]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T02:02:16.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:15 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/3623278524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]: dispatch 2024-09-12T02:02:16.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:15 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]: dispatch 2024-09-12T02:02:16.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:15 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]': finished 2024-09-12T02:02:16.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:15 smithi100 ceph-mon[31179]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T02:02:16.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:16.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:15 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/2045538166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:02:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:15 smithi189 ceph-mon[35188]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T02:02:16.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:15 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/3623278524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]: dispatch 2024-09-12T02:02:16.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:15 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]: dispatch 2024-09-12T02:02:16.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:15 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "011b6708-d8e1-4507-833e-741dc9a33420"}]': finished 2024-09-12T02:02:16.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:15 smithi189 ceph-mon[35188]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T02:02:16.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:16.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:15 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/2045538166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:02:17.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:16 smithi100 ceph-mon[31179]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:16 smithi189 ceph-mon[35188]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:16 smithi117 ceph-mon[35240]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:19 smithi100 ceph-mon[31179]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:19.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:19 smithi189 ceph-mon[35188]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:19.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:19 smithi117 ceph-mon[35240]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:21 smithi100 ceph-mon[31179]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:21.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:21 smithi189 ceph-mon[35188]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:21 smithi117 ceph-mon[35240]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:23.141 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:23 smithi117 ceph-mon[35240]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:23.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:23 smithi100 ceph-mon[31179]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:23 smithi189 ceph-mon[35188]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:24.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:02:24.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:02:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:24.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:02:24.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:25.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:25 smithi100 ceph-mon[31179]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:25.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:25 smithi100 ceph-mon[31179]: Deploying daemon osd.7 on smithi117 2024-09-12T02:02:25.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:25 smithi189 ceph-mon[35188]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:25.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:25 smithi189 ceph-mon[35188]: Deploying daemon osd.7 on smithi117 2024-09-12T02:02:25.385 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:25 smithi117 ceph-mon[35240]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:25.385 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:25 smithi117 ceph-mon[35240]: Deploying daemon osd.7 on smithi117 2024-09-12T02:02:27.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:27 smithi100 ceph-mon[31179]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:27.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:27 smithi189 ceph-mon[35188]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:27.353 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:27 smithi117 ceph-mon[35240]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:29.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:29 smithi100 ceph-mon[31179]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:29.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:29 smithi189 ceph-mon[35188]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:29.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:29 smithi117 ceph-mon[35240]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:30.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:30.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:30.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:30.330 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:30.330 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:30.330 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:30.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:30.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:30.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:31.201 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:31 smithi117 ceph-mon[35240]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:31.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:31 smithi100 ceph-mon[31179]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:31.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:31 smithi189 ceph-mon[35188]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:33.143 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 7 on host 'smithi117' 2024-09-12T02:02:33.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.142+0000 7f58fa7fc640 1 -- 172.21.15.117:0/2946962851 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5908062630 con 0x7f58f40a2bb0 2024-09-12T02:02:33.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:33 smithi117 ceph-mon[35240]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:33.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:33.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:33.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.144+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f58f40a2bb0 msgr2=0x7f58f40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:33.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.144+0000 7f590f3ae640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f58f40a2bb0 0x7f58f40a5070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00bca0 tx=0x7f58fc00b410 comp rx=0 tx=0).stop 2024-09-12T02:02:33.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 msgr2=0x7f59081a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:33.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f59081a5a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5900031ae0 tx=0x7f5900031ee0 comp rx=0 tx=0).stop 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 shutdown_connections 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f58f40a2bb0 0x7f58f40a5070 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5908105790 0x7f59081a5a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5908102de0 0x7f590819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 --2- 172.21.15.117:0/2946962851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5908100490 0x7f590819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 >> 172.21.15.117:0/2946962851 conn(0x7f59080fc2a0 msgr2=0x7f5908100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 shutdown_connections 2024-09-12T02:02:33.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:02:33.145+0000 7f590f3ae640 1 -- 172.21.15.117:0/2946962851 wait complete. 2024-09-12T02:02:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:33 smithi100 ceph-mon[31179]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:33 smithi189 ceph-mon[35188]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:33.731 DEBUG:teuthology.orchestra.run.smithi117:osd.7> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T02:02:33.733 INFO:tasks.cephadm:Deploying osd.8 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-12T02:02:33.733 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:02:33.992 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:02:34.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:34.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:34.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:34.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:34.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:34.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:34.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:35 smithi117 ceph-mon[35240]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:35.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:35 smithi189 ceph-mon[35188]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:35.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:35 smithi100 ceph-mon[31179]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:36.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:02:35 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:02:35.746+0000 7fbc8ca69640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:02:36.484 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:36 smithi117 ceph-mon[35240]: from='osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:02:36.485 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:36 smithi117 ceph-mon[35240]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:02:36.487 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:36 smithi189 ceph-mon[35188]: from='osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:02:36.487 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:36 smithi189 ceph-mon[35188]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:02:36.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:36 smithi100 ceph-mon[31179]: from='osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:02:36.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:36 smithi100 ceph-mon[31179]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:02:36.652 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:02:36.679 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-12T02:02:36.929 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:02:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:37.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:37.345 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 -- 172.21.15.189:0/1036074296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068101c00 msgr2=0x7f3068102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 --2- 172.21.15.189:0/1036074296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068101c00 0x7f3068102000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f305c009900 tx=0x7f305c02a410 comp rx=0 tx=0).stop 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 -- 172.21.15.189:0/1036074296 shutdown_connections 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 --2- 172.21.15.189:0/1036074296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30681037c0 0x7f306810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 --2- 172.21.15.189:0/1036074296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3068102e00 0x7f3068103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 --2- 172.21.15.189:0/1036074296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068101c00 0x7f3068102000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 -- 172.21.15.189:0/1036074296 >> 172.21.15.189:0/1036074296 conn(0x7f30680fd390 msgr2=0x7f30680ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 -- 172.21.15.189:0/1036074296 shutdown_connections 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.447+0000 7f306f49d640 1 -- 172.21.15.189:0/1036074296 wait complete. 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 Processor -- start 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 -- start start 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3068101c00 0x7f3068197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068102e00 0x7f3068198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30681037c0 0x7f306819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f306810d890 con 0x7f3068101c00 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f306810d710 con 0x7f30681037c0 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306f49d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f306810da10 con 0x7f3068102e00 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306ca38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068102e00 0x7f3068198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306ca38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068102e00 0x7f3068198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:48824/0 (socket says 172.21.15.189:48824) 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306ca38640 1 -- 172.21.15.189:0/331931690 learned_addr learned my addr 172.21.15.189:0/331931690 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306da3a640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30681037c0 0x7f306819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.448+0000 7f306d239640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3068101c00 0x7f3068197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306ca38640 1 -- 172.21.15.189:0/331931690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30681037c0 msgr2=0x7f306819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306ca38640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30681037c0 0x7f306819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306ca38640 1 -- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3068101c00 msgr2=0x7f3068197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306ca38640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3068101c00 0x7f3068197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306ca38640 1 -- 172.21.15.189:0/331931690 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306819fb10 con 0x7f3068102e00 2024-09-12T02:02:37.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306d239640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3068101c00 0x7f3068197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306ca38640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068102e00 0x7f3068198420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f306400d950 tx=0x7f306400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f305a7fc640 1 -- 172.21.15.189:0/331931690 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064017030 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f305a7fc640 1 -- 172.21.15.189:0/331931690 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3064004020 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306819fe00 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f305a7fc640 1 -- 172.21.15.189:0/331931690 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640047a0 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.449+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30681a02b0 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.450+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3068108ff0 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.452+0000 7f305a7fc640 1 -- 172.21.15.189:0/331931690 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f30640041d0 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.453+0000 7f305a7fc640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30540a2bb0 0x7f30540a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.453+0000 7f305a7fc640 1 -- 172.21.15.189:0/331931690 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f30640ce420 con 0x7f3068102e00 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.453+0000 7f306d239640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30540a2bb0 0x7f30540a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.453+0000 7f306d239640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30540a2bb0 0x7f30540a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f305c006010 tx=0x7f305c032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:37.464 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.456+0000 7f305a7fc640 1 -- 172.21.15.189:0/331931690 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f306409c000 con 0x7f3068102e00 2024-09-12T02:02:37.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:37.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:37.630+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3068062630 con 0x7f30540a2bb0 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi117 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:38.296 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='osd.7 ' entity='osd.7' 2024-09-12T02:02:38.296 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] boot 2024-09-12T02:02:38.296 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T02:02:38.296 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.399 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:02:38.009+0000 7fbc881c9640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:02:38.400 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:02:38.023+0000 7fbc807fb640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi117 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:02:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:38.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='osd.7 ' entity='osd.7' 2024-09-12T02:02:38.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] boot 2024-09-12T02:02:38.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T02:02:38.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi117 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='osd.7 ' entity='osd.7' 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: osd.7 [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] boot 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T02:02:38.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:02:39.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:39 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:02:39.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:39 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:02:39.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:39 smithi189 ceph-mon[35188]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:02:39.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:39 smithi189 ceph-mon[35188]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:39 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:02:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:39 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:02:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:39 smithi100 ceph-mon[31179]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:02:39.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:39 smithi100 ceph-mon[31179]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:39.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:39 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:02:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:39 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:02:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:39 smithi117 ceph-mon[35240]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:02:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:39 smithi117 ceph-mon[35240]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:02:40.433 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:40 smithi100 ceph-mon[31179]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T02:02:40.433 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:40 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/3528340628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]: dispatch 2024-09-12T02:02:40.433 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:40 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]: dispatch 2024-09-12T02:02:40.433 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:40 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]': finished 2024-09-12T02:02:40.433 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:40 smithi100 ceph-mon[31179]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T02:02:40.433 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:40.562 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:40 smithi189 ceph-mon[35188]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T02:02:40.562 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:40 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/3528340628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]: dispatch 2024-09-12T02:02:40.562 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:40 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]: dispatch 2024-09-12T02:02:40.562 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:40 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]': finished 2024-09-12T02:02:40.562 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:40 smithi189 ceph-mon[35188]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T02:02:40.562 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:40 smithi117 ceph-mon[35240]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T02:02:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:40 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/3528340628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]: dispatch 2024-09-12T02:02:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:40 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]: dispatch 2024-09-12T02:02:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:40 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a00ffca-95d7-433d-bc1a-68396546d03a"}]': finished 2024-09-12T02:02:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:40 smithi117 ceph-mon[35240]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T02:02:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:41.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:41 smithi100 ceph-mon[31179]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:41.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:41 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/810654653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:02:41.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:41 smithi100 ceph-mon[31179]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T02:02:41.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:41 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:41 smithi189 ceph-mon[35188]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:41 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/810654653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:02:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:41 smithi189 ceph-mon[35188]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T02:02:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:41 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:41 smithi117 ceph-mon[35240]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:41 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/810654653' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:02:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:41 smithi117 ceph-mon[35240]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T02:02:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:41 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:43.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:43 smithi100 ceph-mon[31179]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:43.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:43 smithi100 ceph-mon[31179]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T02:02:43.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:43 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:43.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:43 smithi189 ceph-mon[35188]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:43.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:43 smithi189 ceph-mon[35188]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T02:02:43.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:43 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:43.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:43 smithi117 ceph-mon[35240]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:43.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:43 smithi117 ceph-mon[35240]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T02:02:43.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:43 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:02:45.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:45 smithi100 ceph-mon[31179]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:45.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:45 smithi189 ceph-mon[35188]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:45 smithi117 ceph-mon[35240]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:47.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:47 smithi189 ceph-mon[35188]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:47.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:47 smithi117 ceph-mon[35240]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:47.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:47 smithi100 ceph-mon[31179]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:49.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:49 smithi189 ceph-mon[35188]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:49.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:02:49.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:49 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:49 smithi117 ceph-mon[35240]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:02:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:49 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:49.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:49 smithi100 ceph-mon[31179]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:49.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:02:49.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:49 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:50.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:50 smithi189 ceph-mon[35188]: Deploying daemon osd.8 on smithi189 2024-09-12T02:02:50.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:50 smithi117 ceph-mon[35240]: Deploying daemon osd.8 on smithi189 2024-09-12T02:02:50.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:50 smithi100 ceph-mon[31179]: Deploying daemon osd.8 on smithi189 2024-09-12T02:02:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:51 smithi189 ceph-mon[35188]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:51.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:51 smithi117 ceph-mon[35240]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:51.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:51 smithi100 ceph-mon[31179]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:53.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:53 smithi189 ceph-mon[35188]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:53 smithi117 ceph-mon[35240]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:53.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:53 smithi100 ceph-mon[31179]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:55 smithi189 ceph-mon[35188]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:55.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:55 smithi117 ceph-mon[35240]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:55.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:55 smithi100 ceph-mon[31179]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:55.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:55.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:57.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:57 smithi189 ceph-mon[35188]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:57 smithi117 ceph-mon[35240]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:57.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:57 smithi100 ceph-mon[31179]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:58.459 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 8 on host 'smithi189' 2024-09-12T02:02:58.459 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.458+0000 7f305a7fc640 1 -- 172.21.15.189:0/331931690 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3068062630 con 0x7f30540a2bb0 2024-09-12T02:02:58.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30540a2bb0 msgr2=0x7f30540a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30540a2bb0 0x7f30540a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f305c006010 tx=0x7f305c032cf0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068102e00 msgr2=0x7f3068198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:58.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068102e00 0x7f3068198420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f306400d950 tx=0x7f306400de10 comp rx=0 tx=0).stop 2024-09-12T02:02:58.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 shutdown_connections 2024-09-12T02:02:58.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30540a2bb0 0x7f30540a5070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.461 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30681037c0 0x7f306819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3068102e00 0x7f3068198420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 --2- 172.21.15.189:0/331931690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3068101c00 0x7f3068197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:58.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 >> 172.21.15.189:0/331931690 conn(0x7f30680fd390 msgr2=0x7f30681061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:58.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 shutdown_connections 2024-09-12T02:02:58.462 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:02:58.461+0000 7f306f49d640 1 -- 172.21.15.189:0/331931690 wait complete. 2024-09-12T02:02:58.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:58.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:58.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:58 smithi100 ceph-mon[31179]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:58.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:58.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:58.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:58 smithi189 ceph-mon[35188]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:58.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:58.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:58.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:58.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:58 smithi117 ceph-mon[35240]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:02:59.126 DEBUG:teuthology.orchestra.run.smithi189:osd.8> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T02:02:59.129 INFO:tasks.cephadm:Deploying osd.9 on smithi100 with /dev/vg_nvme/lv_1... 2024-09-12T02:02:59.129 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:02:59.385 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:02:59.689 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:59.689 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:59.689 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:02:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:59.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:59.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:59.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:02:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:59.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:59.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:02:59.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:02:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:00.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:00 smithi189 ceph-mon[35188]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:00.703 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:00 smithi100 ceph-mon[31179]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:00.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:00 smithi117 ceph-mon[35240]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:01.343 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:03:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:03:00.892+0000 7fc4958b8640 -1 osd.8 0 log_to_monitors true 2024-09-12T02:03:01.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:01 smithi100 ceph-mon[31179]: from='osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:03:01.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:01 smithi100 ceph-mon[31179]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:03:01.675 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:01 smithi189 ceph-mon[35188]: from='osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:03:01.675 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:01 smithi189 ceph-mon[35188]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:03:01.801 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:01 smithi117 ceph-mon[35240]: from='osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:03:01.801 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:01 smithi117 ceph-mon[35240]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:03:02.201 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:03:02.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2024-09-12T02:03:02.471 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:02.712 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:03:02.712 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:03:02.712 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi189 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:02.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:02.714 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:03:02.460+0000 7fc491018640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T02:03:02.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:03:02.470+0000 7fc48d652640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:03:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:03:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:03:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi189 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:02.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:02.845 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:03:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:03:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi189 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:02.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T02:03:02.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:02.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:02.902 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 -- 172.21.15.100:0/912495712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364101d10 msgr2=0x7f3364102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 --2- 172.21.15.100:0/912495712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364101d10 0x7f3364102190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3358009900 tx=0x7f335802a410 comp rx=0 tx=0).stop 2024-09-12T02:03:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 -- 172.21.15.100:0/912495712 shutdown_connections 2024-09-12T02:03:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 --2- 172.21.15.100:0/912495712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33641026d0 0x7f3364108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 --2- 172.21.15.100:0/912495712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364101d10 0x7f3364102190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 --2- 172.21.15.100:0/912495712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3364100b10 0x7f3364100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 -- 172.21.15.100:0/912495712 >> 172.21.15.100:0/912495712 conn(0x7f33640fc2a0 msgr2=0x7f33640fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 -- 172.21.15.100:0/912495712 shutdown_connections 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 -- 172.21.15.100:0/912495712 wait complete. 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 Processor -- start 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 -- start start 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364100b10 0x7f3364197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3364101d10 0x7f3364198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.909+0000 7f336a04f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33641026d0 0x7f336419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f336a04f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f336410d8c0 con 0x7f3364100b10 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f336a04f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f336410d740 con 0x7f3364101d10 2024-09-12T02:03:02.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f336a04f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f336410da40 con 0x7f33641026d0 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f33637fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364100b10 0x7f3364197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f33637fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364100b10 0x7f3364197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54588/0 (socket says 172.21.15.100:54588) 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f33637fe640 1 -- 172.21.15.100:0/2578119161 learned_addr learned my addr 172.21.15.100:0/2578119161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3362ffd640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3364101d10 0x7f3364198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3363fff640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33641026d0 0x7f336419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3362ffd640 1 -- 172.21.15.100:0/2578119161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33641026d0 msgr2=0x7f336419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3362ffd640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33641026d0 0x7f336419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3362ffd640 1 -- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364100b10 msgr2=0x7f3364197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3362ffd640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364100b10 0x7f3364197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3362ffd640 1 -- 172.21.15.100:0/2578119161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336419fb30 con 0x7f3364101d10 2024-09-12T02:03:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f33637fe640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364100b10 0x7f3364197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3362ffd640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3364101d10 0x7f3364198440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3358031440 tx=0x7f3358031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3360ff9640 1 -- 172.21.15.100:0/2578119161 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335803f070 con 0x7f3364101d10 2024-09-12T02:03:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336419fdc0 con 0x7f3364101d10 2024-09-12T02:03:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3360ff9640 1 -- 172.21.15.100:0/2578119161 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3358003cd0 con 0x7f3364101d10 2024-09-12T02:03:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f3360ff9640 1 -- 172.21.15.100:0/2578119161 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358035070 con 0x7f3364101d10 2024-09-12T02:03:02.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.910+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33641a0240 con 0x7f3364101d10 2024-09-12T02:03:02.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.912+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3364107f60 con 0x7f3364101d10 2024-09-12T02:03:02.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.913+0000 7f3360ff9640 1 -- 172.21.15.100:0/2578119161 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f335803b560 con 0x7f3364101d10 2024-09-12T02:03:02.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.913+0000 7f3360ff9640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f334c0a2bb0 0x7f334c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:02.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.913+0000 7f33637fe640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f334c0a2bb0 0x7f334c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:02.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.913+0000 7f3360ff9640 1 -- 172.21.15.100:0/2578119161 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7f33580ee920 con 0x7f3364101d10 2024-09-12T02:03:02.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.913+0000 7f33637fe640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f334c0a2bb0 0x7f334c0a5070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f33540104e0 tx=0x7f335400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:02.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:02.917+0000 7f3360ff9640 1 -- 172.21.15.100:0/2578119161 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33580bbd00 con 0x7f3364101d10 2024-09-12T02:03:03.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:03.092+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3364062630 con 0x7f334c0a2bb0 2024-09-12T02:03:03.779 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:03:03.779 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:03:03.779 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:03.780 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:03.780 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:03.780 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:03.780 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:03.780 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:03.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:03.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:04.803 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:04 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:03:04.803 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:04 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:03:04.803 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:04 smithi100 ceph-mon[31179]: osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] boot 2024-09-12T02:03:04.803 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:04 smithi100 ceph-mon[31179]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T02:03:04.803 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:04.803 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:04 smithi100 ceph-mon[31179]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:04.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:04 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:03:04.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:04 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:03:04.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:04 smithi189 ceph-mon[35188]: osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] boot 2024-09-12T02:03:04.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:04 smithi189 ceph-mon[35188]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T02:03:04.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:04.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:04 smithi189 ceph-mon[35188]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:04.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:04 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:03:04.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:04 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:03:04.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:04 smithi117 ceph-mon[35240]: osd.8 [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] boot 2024-09-12T02:03:04.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:04 smithi117 ceph-mon[35240]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T02:03:04.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:03:04.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:04 smithi117 ceph-mon[35240]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:03:05.476 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:05 smithi100 ceph-mon[31179]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T02:03:05.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:05 smithi189 ceph-mon[35188]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T02:03:05.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:05 smithi117 ceph-mon[35240]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T02:03:06.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:06 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/135414116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd5e07-6deb-4214-954a-97a4336421be"}]: dispatch 2024-09-12T02:03:06.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:06 smithi189 ceph-mon[35188]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:03:06.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:06 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/135414116' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd5e07-6deb-4214-954a-97a4336421be"}]': finished 2024-09-12T02:03:06.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:06 smithi189 ceph-mon[35188]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T02:03:06.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:06 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:06.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:06 smithi189 ceph-mon[35188]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:06.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:06 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/807701750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:06.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:06 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/135414116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd5e07-6deb-4214-954a-97a4336421be"}]: dispatch 2024-09-12T02:03:06.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:06 smithi117 ceph-mon[35240]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:03:06.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:06 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/135414116' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd5e07-6deb-4214-954a-97a4336421be"}]': finished 2024-09-12T02:03:06.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:06 smithi117 ceph-mon[35240]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T02:03:06.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:06 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:06.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:06 smithi117 ceph-mon[35240]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:06.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:06 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/807701750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:06 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/135414116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd5e07-6deb-4214-954a-97a4336421be"}]: dispatch 2024-09-12T02:03:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:06 smithi100 ceph-mon[31179]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:03:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:06 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/135414116' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd5e07-6deb-4214-954a-97a4336421be"}]': finished 2024-09-12T02:03:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:06 smithi100 ceph-mon[31179]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T02:03:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:06 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:06 smithi100 ceph-mon[31179]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:07.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:06 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/807701750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:07.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:07 smithi189 ceph-mon[35188]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T02:03:07.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:07 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:07.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:07 smithi117 ceph-mon[35240]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T02:03:07.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:07 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:07 smithi100 ceph-mon[31179]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T02:03:08.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:07 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:08.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:08 smithi189 ceph-mon[35188]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T02:03:08.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:08 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:08.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:08 smithi189 ceph-mon[35188]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:08.899 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:08 smithi117 ceph-mon[35240]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T02:03:08.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:08 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:08.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:08 smithi117 ceph-mon[35240]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:09.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:08 smithi100 ceph-mon[31179]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T02:03:09.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:08 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:09.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:08 smithi100 ceph-mon[31179]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:11.184 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:11 smithi100 ceph-mon[31179]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-12T02:03:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:11 smithi189 ceph-mon[35188]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-12T02:03:11.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:11 smithi117 ceph-mon[35240]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-12T02:03:13.291 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:13 smithi100 ceph-mon[31179]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-12T02:03:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:13 smithi189 ceph-mon[35188]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-12T02:03:13.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:13 smithi117 ceph-mon[35240]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-12T02:03:15.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:15 smithi100 ceph-mon[31179]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:03:15.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:03:15.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:15 smithi189 ceph-mon[35188]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:03:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:03:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:15.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:15 smithi117 ceph-mon[35240]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:03:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:03:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:16.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:16 smithi100 ceph-mon[31179]: Deploying daemon osd.9 on smithi100 2024-09-12T02:03:16.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:16 smithi189 ceph-mon[35188]: Deploying daemon osd.9 on smithi100 2024-09-12T02:03:16.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:16 smithi117 ceph-mon[35240]: Deploying daemon osd.9 on smithi100 2024-09-12T02:03:17.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:17 smithi100 ceph-mon[31179]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-12T02:03:17.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:17 smithi189 ceph-mon[35188]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-12T02:03:17.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:17 smithi117 ceph-mon[35240]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-12T02:03:19.163 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:19 smithi100 ceph-mon[31179]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:03:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:19 smithi189 ceph-mon[35188]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:03:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:19 smithi117 ceph-mon[35240]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:03:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:21 smithi100 ceph-mon[31179]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:03:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:21.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:21 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:21.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:21 smithi189 ceph-mon[35188]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:03:21.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:21.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:21.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:21 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:21 smithi117 ceph-mon[35240]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:03:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:21 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:23 smithi100 ceph-mon[31179]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:23 smithi189 ceph-mon[35188]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:23.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:23 smithi117 ceph-mon[35240]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:23.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:23.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:23.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.508+0000 7f3360ff9640 1 -- 172.21.15.100:0/2578119161 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3364062630 con 0x7f334c0a2bb0 2024-09-12T02:03:23.509 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 9 on host 'smithi100' 2024-09-12T02:03:23.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f334c0a2bb0 msgr2=0x7f334c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f334c0a2bb0 0x7f334c0a5070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f33540104e0 tx=0x7f335400b410 comp rx=0 tx=0).stop 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3364101d10 msgr2=0x7f3364198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3364101d10 0x7f3364198440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3358031440 tx=0x7f3358031b60 comp rx=0 tx=0).stop 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 shutdown_connections 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f334c0a2bb0 0x7f334c0a5070 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33641026d0 0x7f336419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3364101d10 0x7f3364198440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 --2- 172.21.15.100:0/2578119161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3364100b10 0x7f3364197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.510+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 >> 172.21.15.100:0/2578119161 conn(0x7f33640fc2a0 msgr2=0x7f3364105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.511+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 shutdown_connections 2024-09-12T02:03:23.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:03:23.511+0000 7f336a04f640 1 -- 172.21.15.100:0/2578119161 wait complete. 2024-09-12T02:03:24.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:24.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:24.110 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:24 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:24.112 DEBUG:teuthology.orchestra.run.smithi100:osd.9> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T02:03:24.115 INFO:tasks.cephadm:Deploying osd.10 on smithi117 with /dev/vg_nvme/lv_1... 2024-09-12T02:03:24.115 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:03:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:24.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:24 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:24.370 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:03:24.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:24 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:25.256 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:25 smithi100 ceph-mon[31179]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:25.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:25 smithi189 ceph-mon[35188]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:25 smithi117 ceph-mon[35240]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:26.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:03:26 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:03:26.410+0000 7ff11e042640 -1 osd.9 0 log_to_monitors true 2024-09-12T02:03:26.820 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T02:03:26.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_1 2024-09-12T02:03:27.102 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:03:27.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:27.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:03:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:27.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:27.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:27.350 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.351 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:27.351 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:27.351 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 -- 172.21.15.117:0/1235040234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 msgr2=0x7f266c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 --2- 172.21.15.117:0/1235040234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c100ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f265c009900 tx=0x7f265c02a410 comp rx=0 tx=0).stop 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 -- 172.21.15.117:0/1235040234 shutdown_connections 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 --2- 172.21.15.117:0/1235040234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f266c102690 0x7f266c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 --2- 172.21.15.117:0/1235040234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f266c101cd0 0x7f266c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 --2- 172.21.15.117:0/1235040234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c100ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 -- 172.21.15.117:0/1235040234 >> 172.21.15.117:0/1235040234 conn(0x7f266c0fc280 msgr2=0x7f266c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:27.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 -- 172.21.15.117:0/1235040234 shutdown_connections 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.552+0000 7f2671823640 1 -- 172.21.15.117:0/1235040234 wait complete. 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.553+0000 7f2671823640 1 Processor -- start 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.553+0000 7f2671823640 1 -- start start 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.553+0000 7f2671823640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.553+0000 7f2671823640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f266c101cd0 0x7f266c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2671823640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f266c102690 0x7f266c19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2671823640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f266c10d880 con 0x7f266c102690 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2671823640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f266c10d700 con 0x7f266c100ad0 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2671823640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f266c10da00 con 0x7f266c101cd0 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59730/0 (socket says 172.21.15.117:59730) 2024-09-12T02:03:27.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 -- 172.21.15.117:0/3438807235 learned_addr learned my addr 172.21.15.117:0/3438807235 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266b7fe640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f266c102690 0x7f266c19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f26627fc640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f266c101cd0 0x7f266c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 -- 172.21.15.117:0/3438807235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f266c101cd0 msgr2=0x7f266c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f266c101cd0 0x7f266c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 -- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f266c102690 msgr2=0x7f266c19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f266c102690 0x7f266c19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 -- 172.21.15.117:0/3438807235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266c19fa90 con 0x7f266c100ad0 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f26627fc640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f266c101cd0 0x7f266c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f266affd640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c197e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f265c031610 tx=0x7f265c0043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2670821640 1 -- 172.21.15.117:0/3438807235 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c03f030 con 0x7f266c100ad0 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2670821640 1 -- 172.21.15.117:0/3438807235 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f265c003ce0 con 0x7f266c100ad0 2024-09-12T02:03:27.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2670821640 1 -- 172.21.15.117:0/3438807235 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c035070 con 0x7f266c100ad0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266c19fd20 con 0x7f266c100ad0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.554+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266c1a01b0 con 0x7f266c100ad0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.556+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266c107f20 con 0x7f266c100ad0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.557+0000 7f2670821640 1 -- 172.21.15.117:0/3438807235 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f265c042030 con 0x7f266c100ad0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.558+0000 7f2670821640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26580a2bb0 0x7f26580a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.558+0000 7f2670821640 1 -- 172.21.15.117:0/3438807235 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5965+0+0 (secure 0 0 0) 0x7f265c0eece0 con 0x7f266c100ad0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.558+0000 7f26627fc640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26580a2bb0 0x7f26580a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.558+0000 7f26627fc640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26580a2bb0 0x7f26580a5070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f266c199380 tx=0x7f265400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:27.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.561+0000 7f2670821640 1 -- 172.21.15.117:0/3438807235 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f265c0bc570 con 0x7f266c100ad0 2024-09-12T02:03:27.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:27.739+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f266c062630 con 0x7f26580a2bb0 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi100 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:28.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:28.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:03:28.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:28 smithi117 ceph-mon[35240]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:03:28.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi100 2024-09-12T02:03:28.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T02:03:28.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:03:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-mon[31179]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi100 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T02:03:28.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:28 smithi189 ceph-mon[35188]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:03:29.157 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:03:28.898+0000 7ff1197a2640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T02:03:29.157 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:03:28 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:03:28.912+0000 7ff111dd4640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:03:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:29 smithi117 ceph-mon[35240]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:29 smithi117 ceph-mon[35240]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:29 smithi117 ceph-mon[35240]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' 2024-09-12T02:03:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:29 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:29 smithi100 ceph-mon[31179]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:29.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:29 smithi100 ceph-mon[31179]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:29.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:29 smithi100 ceph-mon[31179]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' 2024-09-12T02:03:29.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:29 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:29 smithi189 ceph-mon[35188]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:29 smithi189 ceph-mon[35188]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:29 smithi189 ceph-mon[35188]: from='osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779]' entity='osd.9' 2024-09-12T02:03:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:29 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] boot 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/2096254412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]: dispatch 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]: dispatch 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]': finished 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T02:03:30.416 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:30.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] boot 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/2096254412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]: dispatch 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]: dispatch 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]': finished 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T02:03:30.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:30.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: osd.9 [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] boot 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/2096254412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]: dispatch 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]: dispatch 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7"}]': finished 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T02:03:30.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:31.509 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:31 smithi189 ceph-mon[35188]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:31.509 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:31 smithi189 ceph-mon[35188]: from='client.? 172.21.15.117:0/1713906439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:31.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:31 smithi100 ceph-mon[31179]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:31.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:31 smithi100 ceph-mon[31179]: from='client.? 172.21.15.117:0/1713906439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:31.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:31 smithi117 ceph-mon[35240]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:03:31.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:31 smithi117 ceph-mon[35240]: from='client.? 172.21.15.117:0/1713906439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:32.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:32 smithi100 ceph-mon[31179]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T02:03:32.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:32 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:32.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:32 smithi100 ceph-mon[31179]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:32.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:32 smithi189 ceph-mon[35188]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T02:03:32.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:32 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:32.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:32 smithi189 ceph-mon[35188]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:32.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:32 smithi117 ceph-mon[35240]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T02:03:32.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:32 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:32.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:32 smithi117 ceph-mon[35240]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:35.243 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:35 smithi117 ceph-mon[35240]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:35.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:35 smithi100 ceph-mon[31179]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:35.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:35 smithi189 ceph-mon[35188]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:37.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:37 smithi117 ceph-mon[35240]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:37.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:37 smithi100 ceph-mon[31179]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:37 smithi189 ceph-mon[35188]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:39.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:39 smithi117 ceph-mon[35240]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:39.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:03:39.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:39.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:39 smithi100 ceph-mon[31179]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:39.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:03:39.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:39.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:39 smithi189 ceph-mon[35188]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:39.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:03:39.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:40.267 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:40 smithi117 ceph-mon[35240]: Deploying daemon osd.10 on smithi117 2024-09-12T02:03:40.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:40 smithi100 ceph-mon[31179]: Deploying daemon osd.10 on smithi117 2024-09-12T02:03:40.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:40 smithi189 ceph-mon[35188]: Deploying daemon osd.10 on smithi117 2024-09-12T02:03:41.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:41 smithi100 ceph-mon[31179]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:41.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:41 smithi189 ceph-mon[35188]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:41.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:41 smithi117 ceph-mon[35240]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:43.296 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:43 smithi117 ceph-mon[35240]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:43.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:43 smithi100 ceph-mon[31179]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:43.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:43 smithi189 ceph-mon[35188]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:45.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:45 smithi100 ceph-mon[31179]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:45.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:45.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:45.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:45 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:45.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:45 smithi189 ceph-mon[35188]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:45.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:45 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:45.364 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:45 smithi117 ceph-mon[35240]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:45.365 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:45.365 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:45.365 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:45 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:47 smithi189 ceph-mon[35188]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:47.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:47 smithi117 ceph-mon[35240]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:47.440 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 10 on host 'smithi117' 2024-09-12T02:03:47.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.439+0000 7f2670821640 1 -- 172.21.15.117:0/3438807235 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f266c062630 con 0x7f26580a2bb0 2024-09-12T02:03:47.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26580a2bb0 msgr2=0x7f26580a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:47.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26580a2bb0 0x7f26580a5070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f266c199380 tx=0x7f265400a5c0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 msgr2=0x7f266c197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:47.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c197e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f265c031610 tx=0x7f265c0043b0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 shutdown_connections 2024-09-12T02:03:47.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26580a2bb0 0x7f26580a5070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f266c102690 0x7f266c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f266c101cd0 0x7f266c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 --2- 172.21.15.117:0/3438807235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c100ad0 0x7f266c197e60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 >> 172.21.15.117:0/3438807235 conn(0x7f266c0fc280 msgr2=0x7f266c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:47.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 shutdown_connections 2024-09-12T02:03:47.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T02:03:47.442+0000 7f2671823640 1 -- 172.21.15.117:0/3438807235 wait complete. 2024-09-12T02:03:47.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:47 smithi100 ceph-mon[31179]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:48.005 DEBUG:teuthology.orchestra.run.smithi117:osd.10> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T02:03:48.007 INFO:tasks.cephadm:Deploying osd.11 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-12T02:03:48.008 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:03:48.268 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:03:48.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.684 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:48 smithi189 ceph-mon[35188]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:48.684 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.684 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.765 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.765 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.765 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:48 smithi117 ceph-mon[35240]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:48.765 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.765 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:48 smithi100 ceph-mon[31179]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:48.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:50.651 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:03:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:03:50.552+0000 7f795ff66640 -1 osd.10 0 log_to_monitors true 2024-09-12T02:03:51.007 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T02:03:51.035 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-12T02:03:51.296 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:03:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:51.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:51.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:51.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:51.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:51.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:51.768 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 -- 172.21.15.189:0/1230532330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c102700 msgr2=0x7f396c104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:51.768 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 --2- 172.21.15.189:0/1230532330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c102700 0x7f396c104af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3960009900 tx=0x7f396002a410 comp rx=0 tx=0).stop 2024-09-12T02:03:51.768 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 -- 172.21.15.189:0/1230532330 shutdown_connections 2024-09-12T02:03:51.768 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 --2- 172.21.15.189:0/1230532330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c107960 0x7f396c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 --2- 172.21.15.189:0/1230532330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f396c105030 0x7f396c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 --2- 172.21.15.189:0/1230532330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c102700 0x7f396c104af0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 -- 172.21.15.189:0/1230532330 >> 172.21.15.189:0/1230532330 conn(0x7f396c0fc2a0 msgr2=0x7f396c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 -- 172.21.15.189:0/1230532330 shutdown_connections 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.766+0000 7f397412f640 1 -- 172.21.15.189:0/1230532330 wait complete. 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 Processor -- start 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 -- start start 2024-09-12T02:03:51.769 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c102700 0x7f396c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c105030 0x7f396c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f396c107960 0x7f396c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f396c10d8c0 con 0x7f396c102700 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f396c10d740 con 0x7f396c107960 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f397412f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f396c10da40 con 0x7f396c105030 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f39716ca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c105030 0x7f396c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f39716ca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c105030 0x7f396c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36020/0 (socket says 172.21.15.189:36020) 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f39716ca640 1 -- 172.21.15.189:0/3990423550 learned_addr learned my addr 172.21.15.189:0/3990423550 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f3971ecb640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c102700 0x7f396c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.767+0000 7f39726cc640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f396c107960 0x7f396c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f39716ca640 1 -- 172.21.15.189:0/3990423550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f396c107960 msgr2=0x7f396c19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:51.770 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f39716ca640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f396c107960 0x7f396c19f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f39716ca640 1 -- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c102700 msgr2=0x7f396c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f39716ca640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c102700 0x7f396c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f39716ca640 1 -- 172.21.15.189:0/3990423550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c19fb50 con 0x7f396c105030 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f39716ca640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c105030 0x7f396c198460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f396800d740 tx=0x7f396800dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f395effd640 1 -- 172.21.15.189:0/3990423550 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968017070 con 0x7f396c105030 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f395effd640 1 -- 172.21.15.189:0/3990423550 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396800de50 con 0x7f396c105030 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c19fe40 con 0x7f396c105030 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f395effd640 1 -- 172.21.15.189:0/3990423550 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968004e00 con 0x7f396c105030 2024-09-12T02:03:51.771 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.768+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c1a02a0 con 0x7f396c105030 2024-09-12T02:03:51.772 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.769+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c0fdd90 con 0x7f396c105030 2024-09-12T02:03:51.772 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.770+0000 7f395effd640 1 -- 172.21.15.189:0/3990423550 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3968004fa0 con 0x7f396c105030 2024-09-12T02:03:51.772 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.771+0000 7f395effd640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f39580a2bb0 0x7f39580a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:51.772 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.771+0000 7f395effd640 1 -- 172.21.15.189:0/3990423550 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6398+0+0 (secure 0 0 0) 0x7f39680ce4e0 con 0x7f396c105030 2024-09-12T02:03:51.772 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.771+0000 7f3971ecb640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f39580a2bb0 0x7f39580a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:51.772 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.772+0000 7f3971ecb640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f39580a2bb0 0x7f39580a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39600314e0 tx=0x7f3960000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:51.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.774+0000 7f395effd640 1 -- 172.21.15.189:0/3990423550 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f396809b570 con 0x7f396c105030 2024-09-12T02:03:51.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:03:51.948+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f396c062630 con 0x7f39580a2bb0 2024-09-12T02:03:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi117 2024-09-12T02:03:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-12T02:03:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:03:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T02:03:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:52.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:52.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:03:52.072+0000 7f795b6c6640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T02:03:52.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:03:52.085+0000 7f7957d00640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:03:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi117 2024-09-12T02:03:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-12T02:03:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:03:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T02:03:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:03:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:03:52.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:52.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:52.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:52.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:52.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:52.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:52.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:52.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi117 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:03:52.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:03:52.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:53.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:53 smithi189 ceph-mon[35188]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:53.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:53 smithi189 ceph-mon[35188]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:53.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:53 smithi189 ceph-mon[35188]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:03:53.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:53 smithi189 ceph-mon[35188]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:03:53.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:53 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:53.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:53 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:53 smithi117 ceph-mon[35240]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:53 smithi117 ceph-mon[35240]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:53 smithi117 ceph-mon[35240]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:03:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:53 smithi117 ceph-mon[35240]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:03:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:53 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:53 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:53.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:53 smithi100 ceph-mon[31179]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:03:53.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:53 smithi100 ceph-mon[31179]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:03:53.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:53 smithi100 ceph-mon[31179]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-12T02:03:53.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:53 smithi100 ceph-mon[31179]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:03:53.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:53 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:53.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:53 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:54.228 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:54 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:03:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:54 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:03:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:54 smithi189 ceph-mon[35188]: osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] boot 2024-09-12T02:03:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:54 smithi189 ceph-mon[35188]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T02:03:54.229 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:54 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:54.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:54 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:03:54.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:54 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:03:54.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:54 smithi117 ceph-mon[35240]: osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] boot 2024-09-12T02:03:54.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:54 smithi117 ceph-mon[35240]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T02:03:54.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:54 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:54.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:54 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:03:54.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:54 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:03:54.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:54 smithi100 ceph-mon[31179]: osd.10 [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] boot 2024-09-12T02:03:54.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:54 smithi100 ceph-mon[31179]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T02:03:54.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:54 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:03:55.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:55 smithi189 ceph-mon[35188]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:55 smithi189 ceph-mon[35188]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T02:03:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:55 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/3520788025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]: dispatch 2024-09-12T02:03:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:55 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]: dispatch 2024-09-12T02:03:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:55 smithi189 ceph-mon[35188]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]': finished 2024-09-12T02:03:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:55 smithi189 ceph-mon[35188]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T02:03:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:55.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:55 smithi117 ceph-mon[35240]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:55 smithi117 ceph-mon[35240]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T02:03:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:55 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/3520788025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]: dispatch 2024-09-12T02:03:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:55 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]: dispatch 2024-09-12T02:03:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:55 smithi117 ceph-mon[35240]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]': finished 2024-09-12T02:03:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:55 smithi117 ceph-mon[35240]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T02:03:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:55.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:55 smithi100 ceph-mon[31179]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:55 smithi100 ceph-mon[31179]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T02:03:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:55 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/3520788025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]: dispatch 2024-09-12T02:03:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:55 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]: dispatch 2024-09-12T02:03:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:55 smithi100 ceph-mon[31179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37a8335a-5b03-425b-b336-49fb04b357ec"}]': finished 2024-09-12T02:03:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:55 smithi100 ceph-mon[31179]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T02:03:55.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:56 smithi189 ceph-mon[35188]: from='client.? 172.21.15.189:0/839968185' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:56 smithi189 ceph-mon[35188]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T02:03:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:56 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:56.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:56 smithi117 ceph-mon[35240]: from='client.? 172.21.15.189:0/839968185' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:56.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:56 smithi117 ceph-mon[35240]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T02:03:56.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:56 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:56.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:56 smithi100 ceph-mon[31179]: from='client.? 172.21.15.189:0/839968185' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:03:56.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:56 smithi100 ceph-mon[31179]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T02:03:56.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:56 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:57.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:57 smithi189 ceph-mon[35188]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:57.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:57 smithi189 ceph-mon[35188]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T02:03:57.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:57 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:57 smithi117 ceph-mon[35240]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:57 smithi117 ceph-mon[35240]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T02:03:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:57 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:57.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:57 smithi100 ceph-mon[31179]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:57.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:57 smithi100 ceph-mon[31179]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T02:03:57.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:57 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:03:59.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:03:59 smithi189 ceph-mon[35188]: pgmap v229: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:59.371 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:03:59 smithi100 ceph-mon[31179]: pgmap v229: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:03:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:03:59 smithi117 ceph-mon[35240]: pgmap v229: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:01.222 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:01 smithi189 ceph-mon[35188]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T02:04:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:01 smithi117 ceph-mon[35240]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T02:04:01.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:01 smithi100 ceph-mon[31179]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T02:04:03.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:03 smithi189 ceph-mon[35188]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-12T02:04:03.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:03 smithi117 ceph-mon[35240]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-12T02:04:03.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:03 smithi100 ceph-mon[31179]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-12T02:04:04.199 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:04:04.199 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:04 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:04:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:04 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:04.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:04:04.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:04 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:05.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:05 smithi117 ceph-mon[35240]: Deploying daemon osd.11 on smithi189 2024-09-12T02:04:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:05 smithi117 ceph-mon[35240]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:04:05.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:05 smithi189 ceph-mon[35188]: Deploying daemon osd.11 on smithi189 2024-09-12T02:04:05.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:05 smithi189 ceph-mon[35188]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:04:05.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:05 smithi100 ceph-mon[31179]: Deploying daemon osd.11 on smithi189 2024-09-12T02:04:05.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:05 smithi100 ceph-mon[31179]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:04:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:07 smithi189 ceph-mon[35188]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:04:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:07 smithi117 ceph-mon[35240]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:04:07.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:07 smithi100 ceph-mon[31179]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:04:09.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:09 smithi189 ceph-mon[35188]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:04:09.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:09 smithi117 ceph-mon[35240]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:04:09.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:09 smithi100 ceph-mon[31179]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:04:10.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:10.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:10.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:10.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:10.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:10.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:11.449 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:11 smithi189 ceph-mon[35188]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:04:11.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:11 smithi100 ceph-mon[31179]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:04:11.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:11 smithi117 ceph-mon[35240]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:04:12.798 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 11 on host 'smithi189' 2024-09-12T02:04:12.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.797+0000 7f395effd640 1 -- 172.21.15.189:0/3990423550 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f396c062630 con 0x7f39580a2bb0 2024-09-12T02:04:12.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f39580a2bb0 msgr2=0x7f39580a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f39580a2bb0 0x7f39580a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39600314e0 tx=0x7f3960000bc0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c105030 msgr2=0x7f396c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c105030 0x7f396c198460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f396800d740 tx=0x7f396800dc00 comp rx=0 tx=0).stop 2024-09-12T02:04:12.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 shutdown_connections 2024-09-12T02:04:12.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f39580a2bb0 0x7f39580a5070 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f396c107960 0x7f396c19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f396c105030 0x7f396c198460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 --2- 172.21.15.189:0/3990423550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c102700 0x7f396c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 >> 172.21.15.189:0/3990423550 conn(0x7f396c0fc2a0 msgr2=0x7f396c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:12.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 shutdown_connections 2024-09-12T02:04:12.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:12.800+0000 7f397412f640 1 -- 172.21.15.189:0/3990423550 wait complete. 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:13 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:13 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.528 DEBUG:teuthology.orchestra.run.smithi189:osd.11> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T02:04:13.530 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T02:04:13.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:13 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:13.787 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 -- 172.21.15.100:0/3989506490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c1037c0 msgr2=0x7f089c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 --2- 172.21.15.100:0/3989506490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c1037c0 0x7f089c10a050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0894009ca0 tx=0x7f089402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 -- 172.21.15.100:0/3989506490 shutdown_connections 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 --2- 172.21.15.100:0/3989506490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c1037c0 0x7f089c10a050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 --2- 172.21.15.100:0/3989506490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f089c102e00 0x7f089c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 --2- 172.21.15.100:0/3989506490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f089c101c00 0x7f089c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 -- 172.21.15.100:0/3989506490 >> 172.21.15.100:0/3989506490 conn(0x7f089c0fd390 msgr2=0x7f089c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 -- 172.21.15.100:0/3989506490 shutdown_connections 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.261+0000 7f08a0af6640 1 -- 172.21.15.100:0/3989506490 wait complete. 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 Processor -- start 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 -- start start 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f089c101c00 0x7f089c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c102e00 0x7f089c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f089c1037c0 0x7f089c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f089c10d9d0 con 0x7f089c102e00 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f089c10d850 con 0x7f089c1037c0 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f08a0af6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f089c10db50 con 0x7f089c101c00 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f0899d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c102e00 0x7f089c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f0899d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c102e00 0x7f089c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49934/0 (socket says 172.21.15.100:49934) 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f0899d9b640 1 -- 172.21.15.100:0/948213402 learned_addr learned my addr 172.21.15.100:0/948213402 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.262+0000 7f089a59c640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f089c101c00 0x7f089c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f089ad9d640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f089c1037c0 0x7f089c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f0899d9b640 1 -- 172.21.15.100:0/948213402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f089c101c00 msgr2=0x7f089c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f0899d9b640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f089c101c00 0x7f089c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f0899d9b640 1 -- 172.21.15.100:0/948213402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f089c1037c0 msgr2=0x7f089c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f0899d9b640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f089c1037c0 0x7f089c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f0899d9b640 1 -- 172.21.15.100:0/948213402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c0753e0 con 0x7f089c102e00 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f089ad9d640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f089c1037c0 0x7f089c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f0899d9b640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c102e00 0x7f089c0745e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f088c00b4a0 tx=0x7f088c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f08937fe640 1 -- 172.21.15.100:0/948213402 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088c015020 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c1a2180 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f08937fe640 1 -- 172.21.15.100:0/948213402 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f088c011d10 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f08937fe640 1 -- 172.21.15.100:0/948213402 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088c00f2e0 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.263+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c1a2710 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.264+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c102080 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.265+0000 7f08937fe640 1 -- 172.21.15.100:0/948213402 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f088c018020 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.266+0000 7f08937fe640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08880a2b80 0x7f08880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.266+0000 7f089a59c640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08880a2b80 0x7f08880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.267+0000 7f08937fe640 1 -- 172.21.15.100:0/948213402 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7f088c0ce350 con 0x7f089c102e00 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.267+0000 7f089a59c640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08880a2b80 0x7f08880a5040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f089c102c60 tx=0x7f0884009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.271+0000 7f08937fe640 1 -- 172.21.15.100:0/948213402 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f088c01f020 con 0x7f089c102e00 2024-09-12T02:04:14.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.438+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f089c02d7c0 con 0x7f089c102e00 2024-09-12T02:04:14.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.438+0000 7f08937fe640 1 -- 172.21.15.100:0/948213402 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f088c09b890 con 0x7f089c102e00 2024-09-12T02:04:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08880a2b80 msgr2=0x7f08880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08880a2b80 0x7f08880a5040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f089c102c60 tx=0x7f0884009110 comp rx=0 tx=0).stop 2024-09-12T02:04:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c102e00 msgr2=0x7f089c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c102e00 0x7f089c0745e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f088c00b4a0 tx=0x7f088c00b8a0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 shutdown_connections 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08880a2b80 0x7f08880a5040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f089c1037c0 0x7f089c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c102e00 0x7f089c0745e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 --2- 172.21.15.100:0/948213402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f089c101c00 0x7f089c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 >> 172.21.15.100:0/948213402 conn(0x7f089c0fd390 msgr2=0x7f089c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 shutdown_connections 2024-09-12T02:04:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:14.440+0000 7f08a0af6640 1 -- 172.21.15.100:0/948213402 wait complete. 2024-09-12T02:04:15.158 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726106633,"num_in_osds":12,"osd_in_since":1726106634,"num_remapped_pgs":0} 2024-09-12T02:04:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:15 smithi100 ceph-mon[31179]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:15 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/948213402' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:15 smithi189 ceph-mon[35188]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:15 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/948213402' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:15 smithi117 ceph-mon[35240]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:15 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/948213402' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:15.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:04:15 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:04:15.484+0000 7fbe2739d640 -1 osd.11 0 log_to_monitors true 2024-09-12T02:04:16.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:04:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:16 smithi117 ceph-mon[35240]: from='osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:04:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:16 smithi117 ceph-mon[35240]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:04:16.426 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:16.544 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:16 smithi100 ceph-mon[31179]: from='osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:04:16.544 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:16 smithi100 ceph-mon[31179]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:04:16.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:16 smithi189 ceph-mon[35188]: from='osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:04:16.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:16 smithi189 ceph-mon[35188]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:04:16.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 -- 172.21.15.100:0/1933260801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 msgr2=0x7f7818109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 --2- 172.21.15.100:0/1933260801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f7818109000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7810009cd0 tx=0x7f781002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 -- 172.21.15.100:0/1933260801 shutdown_connections 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 --2- 172.21.15.100:0/1933260801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f7818109000 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 --2- 172.21.15.100:0/1933260801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7818100da0 0x7f7818101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 --2- 172.21.15.100:0/1933260801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78181020f0 0x7f78181024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 -- 172.21.15.100:0/1933260801 >> 172.21.15.100:0/1933260801 conn(0x7f78180fba40 msgr2=0x7f78180fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 -- 172.21.15.100:0/1933260801 shutdown_connections 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.866+0000 7f781d1f9640 1 -- 172.21.15.100:0/1933260801 wait complete. 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 Processor -- start 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 -- start start 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7818100da0 0x7f78181007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f781819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78181020f0 0x7f781819f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f781810c7b0 con 0x7f7818101760 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f781810c630 con 0x7f7818100da0 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.867+0000 7f781d1f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f781810c930 con 0x7f78181020f0 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f781819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f781819cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49964/0 (socket says 172.21.15.100:49964) 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 -- 172.21.15.100:0/2490688148 learned_addr learned my addr 172.21.15.100:0/2490688148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f7816d9d640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7818100da0 0x7f78181007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781759e640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78181020f0 0x7f781819f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 -- 172.21.15.100:0/2490688148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78181020f0 msgr2=0x7f781819f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78181020f0 0x7f781819f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 -- 172.21.15.100:0/2490688148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7818100da0 msgr2=0x7f78181007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7818100da0 0x7f78181007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 -- 172.21.15.100:0/2490688148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781819fbc0 con 0x7f7818101760 2024-09-12T02:04:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781659c640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f781819cc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f780800c890 tx=0x7f780800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f77fffff640 1 -- 172.21.15.100:0/2490688148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808004220 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f77fffff640 1 -- 172.21.15.100:0/2490688148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78080043c0 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781819fe50 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f77fffff640 1 -- 172.21.15.100:0/2490688148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808004a00 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.868+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78181a0300 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.869+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7818107f80 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.870+0000 7f77fffff640 1 -- 172.21.15.100:0/2490688148 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f78080079b0 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.871+0000 7f77fffff640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f78000a2b80 0x7f78000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.871+0000 7f7816d9d640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f78000a2b80 0x7f78000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.871+0000 7f77fffff640 1 -- 172.21.15.100:0/2490688148 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6831+0+0 (secure 0 0 0) 0x7f78080ce6a0 con 0x7f7818101760 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.871+0000 7f7816d9d640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f78000a2b80 0x7f78000a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f780c005fd0 tx=0x7f780c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:16.875+0000 7f77fffff640 1 -- 172.21.15.100:0/2490688148 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7808014030 con 0x7f7818101760 2024-09-12T02:04:17.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.043+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f781802da10 con 0x7f7818101760 2024-09-12T02:04:17.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.044+0000 7f77fffff640 1 -- 172.21.15.100:0/2490688148 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f780809b580 con 0x7f7818101760 2024-09-12T02:04:17.045 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.045+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f78000a2b80 msgr2=0x7f78000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.045+0000 7f781d1f9640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f78000a2b80 0x7f78000a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f780c005fd0 tx=0x7f780c00b390 comp rx=0 tx=0).stop 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.045+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 msgr2=0x7f781819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.045+0000 7f781d1f9640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f781819cc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f780800c890 tx=0x7f780800cd50 comp rx=0 tx=0).stop 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 shutdown_connections 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f78000a2b80 0x7f78000a5040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78181020f0 0x7f781819f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7818101760 0x7f781819cc90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 --2- 172.21.15.100:0/2490688148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7818100da0 0x7f78181007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 >> 172.21.15.100:0/2490688148 conn(0x7f78180fba40 msgr2=0x7f7818105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 shutdown_connections 2024-09-12T02:04:17.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:17.046+0000 7f781d1f9640 1 -- 172.21.15.100:0/2490688148 wait complete. 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:17.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:17.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:17 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2490688148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:17 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2490688148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:04:17.114+0000 7fbe22afd640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T02:04:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:04:17.127+0000 7fbe1f137640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:04:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:04:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:04:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:04:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:17.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:17 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2490688148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:17.769 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726106633,"num_in_osds":12,"osd_in_since":1726106634,"num_remapped_pgs":0} 2024-09-12T02:04:18.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:18 smithi117 ceph-mon[35240]: Detected new or changed devices on smithi189 2024-09-12T02:04:18.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:18 smithi117 ceph-mon[35240]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T02:04:18.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:18 smithi117 ceph-mon[35240]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:04:18.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:18 smithi117 ceph-mon[35240]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:04:18.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:18 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:18 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:18 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:18 smithi100 ceph-mon[31179]: Detected new or changed devices on smithi189 2024-09-12T02:04:18.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:18 smithi100 ceph-mon[31179]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T02:04:18.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:18 smithi100 ceph-mon[31179]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:04:18.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:18 smithi100 ceph-mon[31179]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:04:18.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:18 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:18 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:18 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:18 smithi189 ceph-mon[35188]: Detected new or changed devices on smithi189 2024-09-12T02:04:18.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:18 smithi189 ceph-mon[35188]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T02:04:18.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:18 smithi189 ceph-mon[35188]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T02:04:18.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:18 smithi189 ceph-mon[35188]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:04:18.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:18 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:18 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:18 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:18.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:04:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:19 smithi117 ceph-mon[35240]: purged_snaps scrub starts 2024-09-12T02:04:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:19 smithi117 ceph-mon[35240]: purged_snaps scrub ok 2024-09-12T02:04:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:19 smithi117 ceph-mon[35240]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:19 smithi117 ceph-mon[35240]: osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] boot 2024-09-12T02:04:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:19 smithi117 ceph-mon[35240]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T02:04:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:19 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:19.403 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:19 smithi100 ceph-mon[31179]: purged_snaps scrub starts 2024-09-12T02:04:19.403 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:19 smithi100 ceph-mon[31179]: purged_snaps scrub ok 2024-09-12T02:04:19.403 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:19 smithi100 ceph-mon[31179]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:19.404 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:19 smithi100 ceph-mon[31179]: osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] boot 2024-09-12T02:04:19.404 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:19 smithi100 ceph-mon[31179]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T02:04:19.404 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:19 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:19.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 -- 172.21.15.100:0/459100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa058100b10 msgr2=0x7fa058100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 --2- 172.21.15.100:0/459100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa058100b10 0x7fa058100f10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa054009900 tx=0x7fa05402a410 comp rx=0 tx=0).stop 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 -- 172.21.15.100:0/459100 shutdown_connections 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 --2- 172.21.15.100:0/459100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0581026d0 0x7fa058108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 --2- 172.21.15.100:0/459100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa058101d10 0x7fa058102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 --2- 172.21.15.100:0/459100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa058100b10 0x7fa058100f10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 -- 172.21.15.100:0/459100 >> 172.21.15.100:0/459100 conn(0x7fa0580fc2a0 msgr2=0x7fa0580fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 -- 172.21.15.100:0/459100 shutdown_connections 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.481+0000 7fa05f69f640 1 -- 172.21.15.100:0/459100 wait complete. 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 Processor -- start 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 -- start start 2024-09-12T02:04:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa058100b10 0x7fa058198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa058101d10 0x7fa0581985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0581026d0 0x7fa05819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa05810d980 con 0x7fa0581026d0 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa05810d800 con 0x7fa058101d10 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05f69f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa05810db00 con 0x7fa058100b10 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05dc3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0581026d0 0x7fa05819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05dc3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0581026d0 0x7fa05819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49984/0 (socket says 172.21.15.100:49984) 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.482+0000 7fa05dc3c640 1 -- 172.21.15.100:0/1771556399 learned_addr learned my addr 172.21.15.100:0/1771556399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05d43b640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa058100b10 0x7fa058198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05cc3a640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa058101d10 0x7fa0581985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05dc3c640 1 -- 172.21.15.100:0/1771556399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa058100b10 msgr2=0x7fa058198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05dc3c640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa058100b10 0x7fa058198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05dc3c640 1 -- 172.21.15.100:0/1771556399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa058101d10 msgr2=0x7fa0581985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05dc3c640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa058101d10 0x7fa0581985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05dc3c640 1 -- 172.21.15.100:0/1771556399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05819fc90 con 0x7fa0581026d0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05cc3a640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa058101d10 0x7fa0581985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05dc3c640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0581026d0 0x7fa05819f620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b970 tx=0x7fa05000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa04e7fc640 1 -- 172.21.15.100:0/1771556399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050019070 con 0x7fa0581026d0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa04e7fc640 1 -- 172.21.15.100:0/1771556399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa05000cb40 con 0x7fa0581026d0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa04e7fc640 1 -- 172.21.15.100:0/1771556399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050007650 con 0x7fa0581026d0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05819ff80 con 0x7fa0581026d0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.483+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0581a0460 con 0x7fa0581026d0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.484+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa058108000 con 0x7fa0581026d0 2024-09-12T02:04:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.485+0000 7fa04e7fc640 1 -- 172.21.15.100:0/1771556399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa05001c070 con 0x7fa0581026d0 2024-09-12T02:04:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.486+0000 7fa04e7fc640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0440a2bb0 0x7fa0440a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.486+0000 7fa05d43b640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0440a2bb0 0x7fa0440a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.486+0000 7fa04e7fc640 1 -- 172.21.15.100:0/1771556399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa0500ce670 con 0x7fa0581026d0 2024-09-12T02:04:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.486+0000 7fa05d43b640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0440a2bb0 0x7fa0440a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa054006010 tx=0x7fa054000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.489+0000 7fa04e7fc640 1 -- 172.21.15.100:0/1771556399 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa05009ba70 con 0x7fa0581026d0 2024-09-12T02:04:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:19 smithi189 ceph-mon[35188]: purged_snaps scrub starts 2024-09-12T02:04:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:19 smithi189 ceph-mon[35188]: purged_snaps scrub ok 2024-09-12T02:04:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:19 smithi189 ceph-mon[35188]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:04:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:19 smithi189 ceph-mon[35188]: osd.11 [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] boot 2024-09-12T02:04:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:19 smithi189 ceph-mon[35188]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T02:04:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:19 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:04:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.655+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa05802d940 con 0x7fa0581026d0 2024-09-12T02:04:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.656+0000 7fa04e7fc640 1 -- 172.21.15.100:0/1771556399 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fa05009b370 con 0x7fa0581026d0 2024-09-12T02:04:19.657 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0440a2bb0 msgr2=0x7fa0440a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0440a2bb0 0x7fa0440a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa054006010 tx=0x7fa054000bc0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0581026d0 msgr2=0x7fa05819f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0581026d0 0x7fa05819f620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b970 tx=0x7fa05000be30 comp rx=0 tx=0).stop 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 shutdown_connections 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0440a2bb0 0x7fa0440a5070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0581026d0 0x7fa05819f620 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa058101d10 0x7fa0581985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 --2- 172.21.15.100:0/1771556399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa058100b10 0x7fa058198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 >> 172.21.15.100:0/1771556399 conn(0x7fa0580fc2a0 msgr2=0x7fa0581051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 shutdown_connections 2024-09-12T02:04:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:19.658+0000 7fa05f69f640 1 -- 172.21.15.100:0/1771556399 wait complete. 2024-09-12T02:04:20.344 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726106658,"num_in_osds":12,"osd_in_since":1726106634,"num_remapped_pgs":0} 2024-09-12T02:04:20.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:04:20.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:20 smithi117 ceph-mon[35240]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T02:04:20.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:20 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1771556399' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:20.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:20 smithi100 ceph-mon[31179]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T02:04:20.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:20 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1771556399' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:20.585 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:20.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:20 smithi189 ceph-mon[35188]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T02:04:20.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:20 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1771556399' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:04:20.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 -- 172.21.15.100:0/3576744717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8100e20 msgr2=0x7f51c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 --2- 172.21.15.100:0/3576744717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8100e20 0x7f51c8101200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009900 tx=0x7f51b802a480 comp rx=0 tx=0).stop 2024-09-12T02:04:20.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 -- 172.21.15.100:0/3576744717 shutdown_connections 2024-09-12T02:04:20.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 --2- 172.21.15.100:0/3576744717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51c8102ef0 0x7f51c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 --2- 172.21.15.100:0/3576744717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51c8102570 0x7f51c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 --2- 172.21.15.100:0/3576744717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8100e20 0x7f51c8101200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 -- 172.21.15.100:0/3576744717 >> 172.21.15.100:0/3576744717 conn(0x7f51c80fc7d0 msgr2=0x7f51c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:20.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 -- 172.21.15.100:0/3576744717 shutdown_connections 2024-09-12T02:04:20.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.948+0000 7f51ce94b640 1 -- 172.21.15.100:0/3576744717 wait complete. 2024-09-12T02:04:20.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 Processor -- start 2024-09-12T02:04:20.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 -- start start 2024-09-12T02:04:20.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51c8100e20 0x7f51c8197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51c8102570 0x7f51c8197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8102ef0 0x7f51c819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51c8110fa0 con 0x7f51c8102ef0 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51c8110e20 con 0x7f51c8102570 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ce94b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51c8111120 con 0x7f51c8100e20 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8102ef0 0x7f51c819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8102ef0 0x7f51c819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50000/0 (socket says 172.21.15.100:50000) 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 -- 172.21.15.100:0/2166662150 learned_addr learned my addr 172.21.15.100:0/2166662150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51c7fff640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51c8100e20 0x7f51c8197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51bffff640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51c8102570 0x7f51c8197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 -- 172.21.15.100:0/2166662150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51c8100e20 msgr2=0x7f51c8197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51c8100e20 0x7f51c8197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 -- 172.21.15.100:0/2166662150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51c8102570 msgr2=0x7f51c8197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51c8102570 0x7f51c8197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.949+0000 7f51ccee8640 1 -- 172.21.15.100:0/2166662150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c819c3f0 con 0x7f51c8102ef0 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.950+0000 7f51ccee8640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8102ef0 0x7f51c819bd10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51c000b970 tx=0x7f51c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.950+0000 7f51c5ffb640 1 -- 172.21.15.100:0/2166662150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c0019070 con 0x7f51c8102ef0 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.950+0000 7f51c5ffb640 1 -- 172.21.15.100:0/2166662150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c000cb40 con 0x7f51c8102ef0 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.950+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c819c6e0 con 0x7f51c8102ef0 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.950+0000 7f51c5ffb640 1 -- 172.21.15.100:0/2166662150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c0007650 con 0x7f51c8102ef0 2024-09-12T02:04:20.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.950+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c81a3fc0 con 0x7f51c8102ef0 2024-09-12T02:04:20.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.951+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c8101200 con 0x7f51c8102ef0 2024-09-12T02:04:20.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.952+0000 7f51c5ffb640 1 -- 172.21.15.100:0/2166662150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f51c001c070 con 0x7f51c8102ef0 2024-09-12T02:04:20.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.953+0000 7f51c5ffb640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51b40a2b80 0x7f51b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:20.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.953+0000 7f51c7fff640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51b40a2b80 0x7f51b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:20.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.953+0000 7f51c5ffb640 1 -- 172.21.15.100:0/2166662150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f51c00ce100 con 0x7f51c8102ef0 2024-09-12T02:04:20.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.953+0000 7f51c7fff640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51b40a2b80 0x7f51b40a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f51b8000c00 tx=0x7f51b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:20.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:20.957+0000 7f51c5ffb640 1 -- 172.21.15.100:0/2166662150 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51c009aeb0 con 0x7f51c8102ef0 2024-09-12T02:04:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.123+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51c8109090 con 0x7f51c8102ef0 2024-09-12T02:04:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.124+0000 7f51c5ffb640 1 -- 172.21.15.100:0/2166662150 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18550 (secure 0 0 0) 0x7f51c009f1b0 con 0x7f51c8102ef0 2024-09-12T02:04:21.125 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:21.126 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":75,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:04:19.121220+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:04:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51b40a2b80 msgr2=0x7f51b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51b40a2b80 0x7f51b40a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f51b8000c00 tx=0x7f51b80058d0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8102ef0 msgr2=0x7f51c819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8102ef0 0x7f51c819bd10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51c000b970 tx=0x7f51c000be30 comp rx=0 tx=0).stop 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 shutdown_connections 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51b40a2b80 0x7f51b40a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51c8102ef0 0x7f51c819bd10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51c8102570 0x7f51c8197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 --2- 172.21.15.100:0/2166662150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51c8100e20 0x7f51c8197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 >> 172.21.15.100:0/2166662150 conn(0x7f51c80fc7d0 msgr2=0x7f51c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 shutdown_connections 2024-09-12T02:04:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:21.127+0000 7f51ce94b640 1 -- 172.21.15.100:0/2166662150 wait complete. 2024-09-12T02:04:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:21 smithi100 ceph-mon[31179]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:21.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:21 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2166662150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:04:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:21 smithi117 ceph-mon[35240]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:21 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2166662150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:04:21.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:21 smithi189 ceph-mon[35188]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:21.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:21 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2166662150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:04:21.627 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:00:34.232777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:04:21.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T02:04:21.871 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:22.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 -- 172.21.15.100:0/1861568100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 msgr2=0x7f8bbc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 --2- 172.21.15.100:0/1861568100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 0x7f8bbc10d950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009cd0 tx=0x7f8bb402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 -- 172.21.15.100:0/1861568100 shutdown_connections 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 --2- 172.21.15.100:0/1861568100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 0x7f8bbc10d950 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 --2- 172.21.15.100:0/1861568100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bbc100a80 0x7f8bbc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 --2- 172.21.15.100:0/1861568100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bbc106a80 0x7f8bbc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 -- 172.21.15.100:0/1861568100 >> 172.21.15.100:0/1861568100 conn(0x7f8bbc0fc7a0 msgr2=0x7f8bbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 -- 172.21.15.100:0/1861568100 shutdown_connections 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.317+0000 7f8bc355d640 1 -- 172.21.15.100:0/1861568100 wait complete. 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 Processor -- start 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 -- start start 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bbc100a80 0x7f8bbc199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 0x7f8bbc199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bbc106a80 0x7f8bbc1a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc110f20 con 0x7f8bbc101420 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc110da0 con 0x7f8bbc106a80 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.318+0000 7f8bc355d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc1110a0 con 0x7f8bbc100a80 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc12f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bbc100a80 0x7f8bbc199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc0af8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 0x7f8bbc199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc12f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bbc100a80 0x7f8bbc199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:52214/0 (socket says 172.21.15.100:52214) 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc12f9640 1 -- 172.21.15.100:0/3124296442 learned_addr learned my addr 172.21.15.100:0/3124296442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc1afa640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bbc106a80 0x7f8bbc1a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc0af8640 1 -- 172.21.15.100:0/3124296442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bbc100a80 msgr2=0x7f8bbc199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc0af8640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bbc100a80 0x7f8bbc199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc0af8640 1 -- 172.21.15.100:0/3124296442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bbc106a80 msgr2=0x7f8bbc1a4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc0af8640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bbc106a80 0x7f8bbc1a4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc0af8640 1 -- 172.21.15.100:0/3124296442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bbc1a49d0 con 0x7f8bbc101420 2024-09-12T02:04:22.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc1afa640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bbc106a80 0x7f8bbc1a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:22.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc0af8640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 0x7f8bbc199950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800b3f0 tx=0x7f8bb800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bae7fc640 1 -- 172.21.15.100:0/3124296442 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8015020 con 0x7f8bbc101420 2024-09-12T02:04:22.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bae7fc640 1 -- 172.21.15.100:0/3124296442 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bb8011d10 con 0x7f8bbc101420 2024-09-12T02:04:22.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bbc1a4ba0 con 0x7f8bbc101420 2024-09-12T02:04:22.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bae7fc640 1 -- 172.21.15.100:0/3124296442 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800f2e0 con 0x7f8bbc101420 2024-09-12T02:04:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.319+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bbc1a50b0 con 0x7f8bbc101420 2024-09-12T02:04:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.321+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bbc100f60 con 0x7f8bbc101420 2024-09-12T02:04:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.322+0000 7f8bae7fc640 1 -- 172.21.15.100:0/3124296442 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8bb8018020 con 0x7f8bbc101420 2024-09-12T02:04:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.322+0000 7f8bae7fc640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ba80a2c00 0x7f8ba80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.322+0000 7f8bc12f9640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ba80a2c00 0x7f8ba80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.322+0000 7f8bae7fc640 1 -- 172.21.15.100:0/3124296442 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f8bb80ce3a0 con 0x7f8bbc101420 2024-09-12T02:04:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.323+0000 7f8bc12f9640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ba80a2c00 0x7f8ba80a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009a40 tx=0x7f8bb00091c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.327+0000 7f8bae7fc640 1 -- 172.21.15.100:0/3124296442 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8bb801f020 con 0x7f8bbc101420 2024-09-12T02:04:22.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.497+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8bbc109010 con 0x7f8bbc101420 2024-09-12T02:04:22.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.497+0000 7f8bae7fc640 1 -- 172.21.15.100:0/3124296442 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f8bb809b7a0 con 0x7f8bbc101420 2024-09-12T02:04:22.497 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-12T02:04:22.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ba80a2c00 msgr2=0x7f8ba80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ba80a2c00 0x7f8ba80a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009a40 tx=0x7f8bb00091c0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 msgr2=0x7f8bbc199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 0x7f8bbc199950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800b3f0 tx=0x7f8bb800b8b0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 shutdown_connections 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ba80a2c00 0x7f8ba80a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bbc106a80 0x7f8bbc1a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bbc101420 0x7f8bbc199950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 --2- 172.21.15.100:0/3124296442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bbc100a80 0x7f8bbc199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 >> 172.21.15.100:0/3124296442 conn(0x7f8bbc0fc7a0 msgr2=0x7f8bbc0fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 shutdown_connections 2024-09-12T02:04:22.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:22.499+0000 7f8bc355d640 1 -- 172.21.15.100:0/3124296442 wait complete. 2024-09-12T02:04:23.125 INFO:tasks.cephadm:Adding mds.a on smithi100 2024-09-12T02:04:23.125 INFO:tasks.cephadm:Adding mds.d on smithi100 2024-09-12T02:04:23.125 INFO:tasks.cephadm:Adding mds.g on smithi100 2024-09-12T02:04:23.125 INFO:tasks.cephadm:Adding mds.j on smithi100 2024-09-12T02:04:23.125 INFO:tasks.cephadm:Adding mds.b on smithi117 2024-09-12T02:04:23.125 INFO:tasks.cephadm:Adding mds.e on smithi117 2024-09-12T02:04:23.125 INFO:tasks.cephadm:Adding mds.h on smithi117 2024-09-12T02:04:23.126 INFO:tasks.cephadm:Adding mds.k on smithi117 2024-09-12T02:04:23.126 INFO:tasks.cephadm:Adding mds.c on smithi189 2024-09-12T02:04:23.126 INFO:tasks.cephadm:Adding mds.f on smithi189 2024-09-12T02:04:23.126 INFO:tasks.cephadm:Adding mds.i on smithi189 2024-09-12T02:04:23.126 INFO:tasks.cephadm:Adding mds.l on smithi189 2024-09-12T02:04:23.126 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l' 2024-09-12T02:04:23.391 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:04:23.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:23 smithi117 ceph-mon[35240]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:23 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3124296442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:04:23.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:23 smithi189 ceph-mon[35188]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:23.512 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:23 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3124296442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:04:23.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:23 smithi100 ceph-mon[31179]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:23.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:23 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3124296442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 -- 172.21.15.189:0/2817918937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0102690 msgr2=0x7f71b0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 --2- 172.21.15.189:0/2817918937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0102690 0x7f71b0108f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009ca0 tx=0x7f71a802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 -- 172.21.15.189:0/2817918937 shutdown_connections 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 --2- 172.21.15.189:0/2817918937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0102690 0x7f71b0108f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 --2- 172.21.15.189:0/2817918937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b0101cd0 0x7f71b0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 --2- 172.21.15.189:0/2817918937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71b0100ad0 0x7f71b0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 -- 172.21.15.189:0/2817918937 >> 172.21.15.189:0/2817918937 conn(0x7f71b00fc280 msgr2=0x7f71b00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 -- 172.21.15.189:0/2817918937 shutdown_connections 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 -- 172.21.15.189:0/2817918937 wait complete. 2024-09-12T02:04:23.861 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 Processor -- start 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.834+0000 7f71b6630640 1 -- start start 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b6630640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0100ad0 0x7f71b0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b6630640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b0101cd0 0x7f71b0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b6630640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71b0102690 0x7f71b019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b6630640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f71b010d960 con 0x7f71b0102690 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b6630640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f71b010d7e0 con 0x7f71b0101cd0 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b6630640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71b010dae0 con 0x7f71b0100ad0 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0100ad0 0x7f71b0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0100ad0 0x7f71b0198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:51144/0 (socket says 172.21.15.189:51144) 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 -- 172.21.15.189:0/3808699388 learned_addr learned my addr 172.21.15.189:0/3808699388 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71af7fe640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b0101cd0 0x7f71b0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b4bcd640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71b0102690 0x7f71b019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:23.862 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 -- 172.21.15.189:0/3808699388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b0101cd0 msgr2=0x7f71b0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b0101cd0 0x7f71b0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 -- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71b0102690 msgr2=0x7f71b019f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71b0102690 0x7f71b019f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71affff640 1 -- 172.21.15.189:0/3808699388 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b019fc50 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.835+0000 7f71b4bcd640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71b0102690 0x7f71b019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.836+0000 7f71affff640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0100ad0 0x7f71b0198020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71a000b450 tx=0x7f71a000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.836+0000 7f71ad7fa640 1 -- 172.21.15.189:0/3808699388 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0015020 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.836+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b0109940 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.836+0000 7f71ad7fa640 1 -- 172.21.15.189:0/3808699388 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a0011d70 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.836+0000 7f71ad7fa640 1 -- 172.21.15.189:0/3808699388 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000f340 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.836+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b0109f50 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.837+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b002d7c0 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.839+0000 7f71ad7fa640 1 -- 172.21.15.189:0/3808699388 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f71a0018020 con 0x7f71b0100ad0 2024-09-12T02:04:23.863 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.839+0000 7f71ad7fa640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f71980a2bb0 0x7f71980a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:23.864 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.840+0000 7f71ad7fa640 1 -- 172.21.15.189:0/3808699388 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f71a00cebd0 con 0x7f71b0100ad0 2024-09-12T02:04:23.864 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.840+0000 7f71af7fe640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f71980a2bb0 0x7f71980a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:23.864 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.840+0000 7f71af7fe640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f71980a2bb0 0x7f71980a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f71b0199540 tx=0x7f71a4006ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:23.864 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:23.843+0000 7f71ad7fa640 1 -- 172.21.15.189:0/3808699388 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71a001f020 con 0x7f71b0100ad0 2024-09-12T02:04:24.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.019+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}) -- 0x7f71b0062630 con 0x7f71980a2bb0 2024-09-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.027+0000 7f71ad7fa640 1 -- 172.21.15.189:0/3808699388 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f71b0062630 con 0x7f71980a2bb0 2024-09-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mds.all update... 2024-09-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f71980a2bb0 msgr2=0x7f71980a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f71980a2bb0 0x7f71980a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f71b0199540 tx=0x7f71a4006ec0 comp rx=0 tx=0).stop 2024-09-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0100ad0 msgr2=0x7f71b0198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0100ad0 0x7f71b0198020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71a000b450 tx=0x7f71a000b910 comp rx=0 tx=0).stop 2024-09-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 shutdown_connections 2024-09-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f71980a2bb0 0x7f71980a5070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71b0102690 0x7f71b019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71b0101cd0 0x7f71b0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 --2- 172.21.15.189:0/3808699388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71b0100ad0 0x7f71b0198020 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 >> 172.21.15.189:0/3808699388 conn(0x7f71b00fc280 msgr2=0x7f71b01050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 shutdown_connections 2024-09-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T02:04:24.029+0000 7f71b6630640 1 -- 172.21.15.189:0/3808699388 wait complete. 2024-09-12T02:04:24.735 DEBUG:teuthology.orchestra.run.smithi100:mds.a> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T02:04:24.737 DEBUG:teuthology.orchestra.run.smithi100:mds.d> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T02:04:24.780 DEBUG:teuthology.orchestra.run.smithi100:mds.g> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T02:04:24.825 DEBUG:teuthology.orchestra.run.smithi100:mds.j> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T02:04:24.867 DEBUG:teuthology.orchestra.run.smithi117:mds.b> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T02:04:24.870 DEBUG:teuthology.orchestra.run.smithi117:mds.e> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T02:04:24.915 DEBUG:teuthology.orchestra.run.smithi117:mds.h> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T02:04:24.957 DEBUG:teuthology.orchestra.run.smithi117:mds.k> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T02:04:25.001 DEBUG:teuthology.orchestra.run.smithi189:mds.c> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T02:04:25.003 DEBUG:teuthology.orchestra.run.smithi189:mds.f> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T02:04:25.046 DEBUG:teuthology.orchestra.run.smithi189:mds.i> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T02:04:25.089 DEBUG:teuthology.orchestra.run.smithi189:mds.l> sudo journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T02:04:25.131 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T02:04:25.132 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:25.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:25 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:25.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:25.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:25 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: Saving service mds.all spec with placement smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:25.320 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:25 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:25.378 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 -- 172.21.15.100:0/1954464462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 msgr2=0x7f18b4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 --2- 172.21.15.100:0/1954464462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b4100ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009930 tx=0x7f18b002a420 comp rx=0 tx=0).stop 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 -- 172.21.15.100:0/1954464462 shutdown_connections 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 --2- 172.21.15.100:0/1954464462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b4101420 0x7f18b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 --2- 172.21.15.100:0/1954464462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b4100ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 --2- 172.21.15.100:0/1954464462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4106a80 0x7f18b4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 -- 172.21.15.100:0/1954464462 >> 172.21.15.100:0/1954464462 conn(0x7f18b40fc7a0 msgr2=0x7f18b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:25.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 -- 172.21.15.100:0/1954464462 shutdown_connections 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.813+0000 7f18bb42d640 1 -- 172.21.15.100:0/1954464462 wait complete. 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 Processor -- start 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 -- start start 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b41a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b4101420 0x7f18b41a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4106a80 0x7f18b419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4110e80 con 0x7f18b4100a80 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4110d00 con 0x7f18b4106a80 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18bb42d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4111000 con 0x7f18b4101420 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b41a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b41a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57124/0 (socket says 172.21.15.100:57124) 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 -- 172.21.15.100:0/2564465795 learned_addr learned my addr 172.21.15.100:0/2564465795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:25.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b89c8640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b4101420 0x7f18b41a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 -- 172.21.15.100:0/2564465795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b4101420 msgr2=0x7f18b41a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b4101420 0x7f18b41a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 -- 172.21.15.100:0/2564465795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4106a80 msgr2=0x7f18b419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4106a80 0x7f18b419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 -- 172.21.15.100:0/2564465795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b419f330 con 0x7f18b4100a80 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b89c8640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b4101420 0x7f18b41a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.814+0000 7f18b91c9640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b41a4820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f18a400d950 tx=0x7f18a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.815+0000 7f18aa7fc640 1 -- 172.21.15.100:0/2564465795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4017070 con 0x7f18b4100a80 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.815+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b419f620 con 0x7f18b4100a80 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.815+0000 7f18aa7fc640 1 -- 172.21.15.100:0/2564465795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18a4009c30 con 0x7f18b4100a80 2024-09-12T02:04:25.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.815+0000 7f18aa7fc640 1 -- 172.21.15.100:0/2564465795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a400f6b0 con 0x7f18b4100a80 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.815+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b41ab7e0 con 0x7f18b4100a80 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.815+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b41021c0 con 0x7f18b4100a80 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.817+0000 7f18aa7fc640 1 -- 172.21.15.100:0/2564465795 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f18a40109d0 con 0x7f18b4100a80 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.817+0000 7f18aa7fc640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f18a00a2b80 0x7f18a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.818+0000 7f18b89c8640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f18a00a2b80 0x7f18a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.818+0000 7f18aa7fc640 1 -- 172.21.15.100:0/2564465795 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f18a40ce810 con 0x7f18b4100a80 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.818+0000 7f18b89c8640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f18a00a2b80 0x7f18a00a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000c00 tx=0x7f18b0032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:25.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:25.820+0000 7f18aa7fc640 1 -- 172.21.15.100:0/2564465795 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18a4009de0 con 0x7f18b4100a80 2024-09-12T02:04:26.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.020+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18b41ab9b0 con 0x7f18b4100a80 2024-09-12T02:04:26.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.021+0000 7f18aa7fc640 1 -- 172.21.15.100:0/2564465795 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f18a409bc10 con 0x7f18b4100a80 2024-09-12T02:04:26.021 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:26.021 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"btime":"2024-09-12T01:57:36:929801+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T02:04:26.021 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 1 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f18a00a2b80 msgr2=0x7f18a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f18a00a2b80 0x7f18a00a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000c00 tx=0x7f18b0032c70 comp rx=0 tx=0).stop 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 msgr2=0x7f18b41a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b41a4820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f18a400d950 tx=0x7f18a400de10 comp rx=0 tx=0).stop 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 shutdown_connections 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f18a00a2b80 0x7f18a00a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18b4106a80 0x7f18b419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18b4101420 0x7f18b41a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 --2- 172.21.15.100:0/2564465795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b4100a80 0x7f18b41a4820 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:26.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 >> 172.21.15.100:0/2564465795 conn(0x7f18b40fc7a0 msgr2=0x7f18b406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:26.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 shutdown_connections 2024-09-12T02:04:26.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:26.023+0000 7f18bb42d640 1 -- 172.21.15.100:0/2564465795 wait complete. 2024-09-12T02:04:26.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:26 smithi100 ceph-mon[31179]: Deploying daemon mds.l on smithi189 2024-09-12T02:04:26.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:26 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2564465795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:26.199 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:26 smithi189 ceph-mon[35188]: Deploying daemon mds.l on smithi189 2024-09-12T02:04:26.200 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:26 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2564465795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:26 smithi117 ceph-mon[35240]: Deploying daemon mds.l on smithi189 2024-09-12T02:04:26.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:26 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2564465795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:26.590 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 systemd[1]: Starting Ceph mds.l for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:26.842 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 podman[65544]: 2024-09-12 02:04:26.49312407 +0000 UTC m=+0.015924230 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:26.842 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 podman[65544]: 2024-09-12 02:04:26.615333022 +0000 UTC m=+0.138133185 container create 2ccae9915985b284b88bf19c61236b3b1e501a46003bbcb4206b5d22042caa10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:04:26.842 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 podman[65544]: 2024-09-12 02:04:26.8429183 +0000 UTC m=+0.365718463 container init 2ccae9915985b284b88bf19c61236b3b1e501a46003bbcb4206b5d22042caa10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:04:27.093 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 podman[65544]: 2024-09-12 02:04:26.845675145 +0000 UTC m=+0.368475305 container start 2ccae9915985b284b88bf19c61236b3b1e501a46003bbcb4206b5d22042caa10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:04:27.093 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 ceph-mds[65564]: -- 172.21.15.189:0/1121630798 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578dc6d1860 con 0x5578dc6af400 2024-09-12T02:04:27.093 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l[65560]: starting mds.l at 2024-09-12T02:04:27.093 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 bash[65544]: 2ccae9915985b284b88bf19c61236b3b1e501a46003bbcb4206b5d22042caa10 2024-09-12T02:04:27.093 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:04:26 smithi189 systemd[1]: Started Ceph mds.l for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6832/2089566661,v1:172.21.15.189:6833/2089566661] up:boot 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: fsmap 1 up:standby 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:27.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:27 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6832/2089566661,v1:172.21.15.189:6833/2089566661] up:boot 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: fsmap 1 up:standby 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:27.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:27 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:27.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:27.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6832/2089566661,v1:172.21.15.189:6833/2089566661] up:boot 2024-09-12T02:04:27.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: fsmap 1 up:standby 2024-09-12T02:04:27.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:04:27.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.393 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:27.394 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:27.394 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:27.394 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:27 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:28.311 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:28 smithi117 ceph-mon[35240]: Deploying daemon mds.k on smithi117 2024-09-12T02:04:28.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:28 smithi100 ceph-mon[31179]: Deploying daemon mds.k on smithi117 2024-09-12T02:04:28.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:28 smithi189 ceph-mon[35188]: Deploying daemon mds.k on smithi117 2024-09-12T02:04:28.652 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:28.900 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:28 smithi117 systemd[1]: Starting Ceph mds.k for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:28.906 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:29.242 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:29 smithi117 ceph-mon[35240]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:29.242 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:28 smithi117 podman[65101]: 2024-09-12 02:04:28.883275907 +0000 UTC m=+0.016181639 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:29.242 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:28 smithi117 podman[65101]: 2024-09-12 02:04:28.997693734 +0000 UTC m=+0.130599511 container create 36bbe14017a520f2abdd00d3489787628b0e8a6e0ec8b9f5e276e6d79e79e56d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:04:29.242 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:29 smithi117 podman[65101]: 2024-09-12 02:04:29.216536417 +0000 UTC m=+0.349442149 container init 36bbe14017a520f2abdd00d3489787628b0e8a6e0ec8b9f5e276e6d79e79e56d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T02:04:29.243 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:29 smithi117 podman[65101]: 2024-09-12 02:04:29.21939466 +0000 UTC m=+0.352300401 container start 36bbe14017a520f2abdd00d3489787628b0e8a6e0ec8b9f5e276e6d79e79e56d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:29.243 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:29 smithi117 ceph-mds[65120]: -- 172.21.15.117:0/4037050617 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f3552d5860 con 0x55f3552b3400 2024-09-12T02:04:29.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:29 smithi100 ceph-mon[31179]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:29.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:29 smithi189 ceph-mon[35188]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 -- 172.21.15.100:0/2548228204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102ef0 msgr2=0x7f3dac10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 --2- 172.21.15.100:0/2548228204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102ef0 0x7f3dac10da40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009900 tx=0x7f3d9c02a480 comp rx=0 tx=0).stop 2024-09-12T02:04:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 -- 172.21.15.100:0/2548228204 shutdown_connections 2024-09-12T02:04:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 --2- 172.21.15.100:0/2548228204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102ef0 0x7f3dac10da40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 --2- 172.21.15.100:0/2548228204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3dac102570 0x7f3dac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 --2- 172.21.15.100:0/2548228204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac100e20 0x7f3dac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 -- 172.21.15.100:0/2548228204 >> 172.21.15.100:0/2548228204 conn(0x7f3dac0fc7d0 msgr2=0x7f3dac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 -- 172.21.15.100:0/2548228204 shutdown_connections 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.366+0000 7f3db3c59640 1 -- 172.21.15.100:0/2548228204 wait complete. 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 Processor -- start 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 -- start start 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3dac100e20 0x7f3dac0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102570 0x7f3dac0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac102ef0 0x7f3dac0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac110f80 con 0x7f3dac102570 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac110e00 con 0x7f3dac102ef0 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db3c59640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac111100 con 0x7f3dac100e20 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102570 0x7f3dac0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102570 0x7f3dac0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57136/0 (socket says 172.21.15.100:57136) 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 -- 172.21.15.100:0/3433139619 learned_addr learned my addr 172.21.15.100:0/3433139619 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db21f6640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac102ef0 0x7f3dac0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db19f5640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3dac100e20 0x7f3dac0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 -- 172.21.15.100:0/3433139619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3dac100e20 msgr2=0x7f3dac0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3dac100e20 0x7f3dac0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 -- 172.21.15.100:0/3433139619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac102ef0 msgr2=0x7f3dac0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac102ef0 0x7f3dac0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.367+0000 7f3db11f4640 1 -- 172.21.15.100:0/3433139619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac1a69c0 con 0x7f3dac102570 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.368+0000 7f3db11f4640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102570 0x7f3dac0fd1c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c970 tx=0x7f3da000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.368+0000 7f3daaffd640 1 -- 172.21.15.100:0/3433139619 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0007bb0 con 0x7f3dac102570 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.368+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac1a6cb0 con 0x7f3dac102570 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.368+0000 7f3daaffd640 1 -- 172.21.15.100:0/3433139619 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3da0007d50 con 0x7f3dac102570 2024-09-12T02:04:29.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.368+0000 7f3daaffd640 1 -- 172.21.15.100:0/3433139619 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da000f450 con 0x7f3dac102570 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.368+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1a71a0 con 0x7f3dac102570 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.369+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac101200 con 0x7f3dac102570 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.371+0000 7f3daaffd640 1 -- 172.21.15.100:0/3433139619 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3da0004fe0 con 0x7f3dac102570 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.371+0000 7f3daaffd640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3d940a2b80 0x7f3d940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.371+0000 7f3db19f5640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3d940a2b80 0x7f3d940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.371+0000 7f3daaffd640 1 -- 172.21.15.100:0/3433139619 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f3da00cecb0 con 0x7f3dac102570 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.372+0000 7f3db19f5640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3d940a2b80 0x7f3d940a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005fd0 tx=0x7f3da40098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:29.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.374+0000 7f3daaffd640 1 -- 172.21.15.100:0/3433139619 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3da0014030 con 0x7f3dac102570 2024-09-12T02:04:29.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.590+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dac0fe1b0 con 0x7f3dac102570 2024-09-12T02:04:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.591+0000 7f3daaffd640 1 -- 172.21.15.100:0/3433139619 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f3dac0fe1b0 con 0x7f3dac102570 2024-09-12T02:04:29.592 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-09-12T02:04:29.592 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:29.592 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"btime":"2024-09-12T02:04:26:874184+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:04:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3d940a2b80 msgr2=0x7f3d940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3d940a2b80 0x7f3d940a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005fd0 tx=0x7f3da40098b0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102570 msgr2=0x7f3dac0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102570 0x7f3dac0fd1c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c970 tx=0x7f3da000ce30 comp rx=0 tx=0).stop 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 shutdown_connections 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3d940a2b80 0x7f3d940a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac102ef0 0x7f3dac0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102570 0x7f3dac0fd1c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 --2- 172.21.15.100:0/3433139619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3dac100e20 0x7f3dac0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 >> 172.21.15.100:0/3433139619 conn(0x7f3dac0fc7d0 msgr2=0x7f3dac06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 shutdown_connections 2024-09-12T02:04:29.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:29.593+0000 7f3db3c59640 1 -- 172.21.15.100:0/3433139619 wait complete. 2024-09-12T02:04:29.649 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:29 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k[65116]: starting mds.k at 2024-09-12T02:04:29.650 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:29 smithi117 bash[65101]: 36bbe14017a520f2abdd00d3489787628b0e8a6e0ec8b9f5e276e6d79e79e56d 2024-09-12T02:04:29.650 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:04:29 smithi117 systemd[1]: Started Ceph mds.k for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:30.549 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.549 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.549 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.549 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: Deploying daemon mds.j on smithi100 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3433139619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6832/1856036067,v1:172.21.15.117:6833/1856036067] up:boot 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: fsmap 2 up:standby 2024-09-12T02:04:30.550 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:30 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:04:30.639 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.639 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.639 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: Deploying daemon mds.j on smithi100 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3433139619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6832/1856036067,v1:172.21.15.117:6833/1856036067] up:boot 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: fsmap 2 up:standby 2024-09-12T02:04:30.640 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:30 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:04:30.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:30.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:30.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:30.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:30.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: Deploying daemon mds.j on smithi100 2024-09-12T02:04:30.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3433139619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:30.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:30.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6832/1856036067,v1:172.21.15.117:6833/1856036067] up:boot 2024-09-12T02:04:30.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: fsmap 2 up:standby 2024-09-12T02:04:30.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:30 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:04:32.069 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:31 smithi100 systemd[1]: Starting Ceph mds.j for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:32.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:32.459 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 podman[70194]: 2024-09-12 02:04:32.108893024 +0000 UTC m=+0.015676648 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:32.459 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 podman[70194]: 2024-09-12 02:04:32.214162991 +0000 UTC m=+0.120946611 container create 6c5eebf8ab2eb3a0f002cf0d1a813df110688d69c9edbf7accf00e8adc4f0de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T02:04:32.459 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 podman[70194]: 2024-09-12 02:04:32.433300586 +0000 UTC m=+0.340084207 container init 6c5eebf8ab2eb3a0f002cf0d1a813df110688d69c9edbf7accf00e8adc4f0de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-12T02:04:32.460 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 podman[70194]: 2024-09-12 02:04:32.436359336 +0000 UTC m=+0.343142952 container start 6c5eebf8ab2eb3a0f002cf0d1a813df110688d69c9edbf7accf00e8adc4f0de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:32.741 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 ceph-mds[70230]: -- 172.21.15.100:0/1815461872 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562815bcb860 con 0x562815ba9400 2024-09-12T02:04:32.741 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j[70226]: starting mds.j at 2024-09-12T02:04:32.741 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 bash[70194]: 6c5eebf8ab2eb3a0f002cf0d1a813df110688d69c9edbf7accf00e8adc4f0de2 2024-09-12T02:04:32.741 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:04:32 smithi100 systemd[1]: Started Ceph mds.j for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 -- 172.21.15.100:0/642551192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c106a90 msgr2=0x7fc85c106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 --2- 172.21.15.100:0/642551192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c106a90 0x7fc85c106e70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009930 tx=0x7fc84c02a420 comp rx=0 tx=0).stop 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 -- 172.21.15.100:0/642551192 shutdown_connections 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 --2- 172.21.15.100:0/642551192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc85c101430 0x7fc85c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 --2- 172.21.15.100:0/642551192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85c100a90 0x7fc85c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 --2- 172.21.15.100:0/642551192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c106a90 0x7fc85c106e70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 -- 172.21.15.100:0/642551192 >> 172.21.15.100:0/642551192 conn(0x7fc85c0fc7d0 msgr2=0x7fc85c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 -- 172.21.15.100:0/642551192 shutdown_connections 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.070+0000 7fc862500640 1 -- 172.21.15.100:0/642551192 wait complete. 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 Processor -- start 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 -- start start 2024-09-12T02:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc85c100a90 0x7fc85c102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c101430 0x7fc85c102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85c106a90 0x7fc85c1030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c110ee0 con 0x7fc85c101430 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c110d60 con 0x7fc85c106a90 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc862500640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c111060 con 0x7fc85c100a90 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc853fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c101430 0x7fc85c102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc853fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c101430 0x7fc85c102ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57174/0 (socket says 172.21.15.100:57174) 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.071+0000 7fc853fff640 1 -- 172.21.15.100:0/4132468768 learned_addr learned my addr 172.21.15.100:0/4132468768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc860a9d640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85c106a90 0x7fc85c1030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc85bfff640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc85c100a90 0x7fc85c102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc853fff640 1 -- 172.21.15.100:0/4132468768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc85c100a90 msgr2=0x7fc85c102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc853fff640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc85c100a90 0x7fc85c102660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc853fff640 1 -- 172.21.15.100:0/4132468768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85c106a90 msgr2=0x7fc85c1030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc853fff640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85c106a90 0x7fc85c1030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc853fff640 1 -- 172.21.15.100:0/4132468768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c1a6920 con 0x7fc85c101430 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc860a9d640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85c106a90 0x7fc85c1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc853fff640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c101430 0x7fc85c102ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc84400d950 tx=0x7fc84400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc859ffb640 1 -- 172.21.15.100:0/4132468768 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844017070 con 0x7fc85c101430 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c1a6c10 con 0x7fc85c101430 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc859ffb640 1 -- 172.21.15.100:0/4132468768 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc844009c30 con 0x7fc85c101430 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc859ffb640 1 -- 172.21.15.100:0/4132468768 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84400f6b0 con 0x7fc85c101430 2024-09-12T02:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.072+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c1a71a0 con 0x7fc85c101430 2024-09-12T02:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.074+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85c100ef0 con 0x7fc85c101430 2024-09-12T02:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.074+0000 7fc859ffb640 1 -- 172.21.15.100:0/4132468768 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc8440109d0 con 0x7fc85c101430 2024-09-12T02:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.075+0000 7fc859ffb640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc8480a2b80 0x7fc8480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.075+0000 7fc859ffb640 1 -- 172.21.15.100:0/4132468768 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc8440cebe0 con 0x7fc85c101430 2024-09-12T02:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.076+0000 7fc85bfff640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc8480a2b80 0x7fc8480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.076+0000 7fc85bfff640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc8480a2b80 0x7fc8480a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc84c006010 tx=0x7fc84c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.080+0000 7fc859ffb640 1 -- 172.21.15.100:0/4132468768 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc844009de0 con 0x7fc85c101430 2024-09-12T02:04:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.287+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc85c1a7370 con 0x7fc85c101430 2024-09-12T02:04:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.288+0000 7fc859ffb640 1 -- 172.21.15.100:0/4132468768 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fc84409bfe0 con 0x7fc85c101430 2024-09-12T02:04:33.288 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:33.288 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":4,"btime":"2024-09-12T02:04:33:060126+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:04:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 4 2024-09-12T02:04:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc8480a2b80 msgr2=0x7fc8480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc8480a2b80 0x7fc8480a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc84c006010 tx=0x7fc84c005a20 comp rx=0 tx=0).stop 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c101430 msgr2=0x7fc85c102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c101430 0x7fc85c102ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc84400d950 tx=0x7fc84400de10 comp rx=0 tx=0).stop 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 shutdown_connections 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc8480a2b80 0x7fc8480a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85c106a90 0x7fc85c1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc85c101430 0x7fc85c102ba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 --2- 172.21.15.100:0/4132468768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc85c100a90 0x7fc85c102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 >> 172.21.15.100:0/4132468768 conn(0x7fc85c0fc7d0 msgr2=0x7fc85c104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 shutdown_connections 2024-09-12T02:04:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:33.290+0000 7fc862500640 1 -- 172.21.15.100:0/4132468768 wait complete. 2024-09-12T02:04:33.300 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:33 smithi100 ceph-mon[31179]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:33.300 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.300 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.300 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.300 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:33.301 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:33.301 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:33 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:33 smithi189 ceph-mon[35188]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:33.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:33 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:33 smithi117 ceph-mon[35240]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:33 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:34 smithi100 ceph-mon[31179]: Deploying daemon mds.d on smithi100 2024-09-12T02:04:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:34 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.100:6834/984711890,v1:172.21.15.100:6835/984711890] up:boot 2024-09-12T02:04:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:34 smithi100 ceph-mon[31179]: fsmap 3 up:standby 2024-09-12T02:04:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:34 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:04:34.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:34 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4132468768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:34 smithi189 ceph-mon[35188]: Deploying daemon mds.d on smithi100 2024-09-12T02:04:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:34 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.100:6834/984711890,v1:172.21.15.100:6835/984711890] up:boot 2024-09-12T02:04:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:34 smithi189 ceph-mon[35188]: fsmap 3 up:standby 2024-09-12T02:04:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:34 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:04:34.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:34 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/4132468768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:34 smithi117 ceph-mon[35240]: Deploying daemon mds.d on smithi100 2024-09-12T02:04:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:34 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.100:6834/984711890,v1:172.21.15.100:6835/984711890] up:boot 2024-09-12T02:04:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:34 smithi117 ceph-mon[35240]: fsmap 3 up:standby 2024-09-12T02:04:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:34 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:04:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:34 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/4132468768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:35.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:35 smithi189 ceph-mon[35188]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:35 smithi117 ceph-mon[35240]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:35.491 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:35 smithi100 ceph-mon[31179]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:35.491 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 systemd[1]: Starting Ceph mds.d for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:35.768 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 podman[70603]: 2024-09-12 02:04:35.393840538 +0000 UTC m=+0.015731996 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:35.768 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 podman[70603]: 2024-09-12 02:04:35.491712458 +0000 UTC m=+0.113603909 container create 37ac9312cbbc3f4075ace3c5a61fc09787cd6fce20b16a8aa229ed6531398e19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T02:04:35.769 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 podman[70603]: 2024-09-12 02:04:35.769115206 +0000 UTC m=+0.391006655 container init 37ac9312cbbc3f4075ace3c5a61fc09787cd6fce20b16a8aa229ed6531398e19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:04:36.068 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 podman[70603]: 2024-09-12 02:04:35.772087029 +0000 UTC m=+0.393978471 container start 37ac9312cbbc3f4075ace3c5a61fc09787cd6fce20b16a8aa229ed6531398e19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T02:04:36.069 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 ceph-mds[70622]: -- 172.21.15.100:0/2346899987 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55617011b860 con 0x5561700f9400 2024-09-12T02:04:36.069 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d[70618]: starting mds.d at 2024-09-12T02:04:36.069 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 bash[70603]: 37ac9312cbbc3f4075ace3c5a61fc09787cd6fce20b16a8aa229ed6531398e19 2024-09-12T02:04:36.069 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:04:35 smithi100 systemd[1]: Started Ceph mds.d for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:36.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:36.689 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:37.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: Deploying daemon mds.e on smithi117 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.100:6836/650735571,v1:172.21.15.100:6837/650735571] up:boot 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: fsmap 4 up:standby 2024-09-12T02:04:37.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:36 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:04:37.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 -- 172.21.15.100:0/1842663886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c10c180 msgr2=0x7f374c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 --2- 172.21.15.100:0/1842663886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c10c180 0x7f374c10e600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f373c009900 tx=0x7f373c02a480 comp rx=0 tx=0).stop 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 -- 172.21.15.100:0/1842663886 shutdown_connections 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 --2- 172.21.15.100:0/1842663886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c10c180 0x7f374c10e600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 --2- 172.21.15.100:0/1842663886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374c1036c0 0x7f374c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 --2- 172.21.15.100:0/1842663886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c102da0 0x7f374c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 -- 172.21.15.100:0/1842663886 >> 172.21.15.100:0/1842663886 conn(0x7f374c0fc7a0 msgr2=0x7f374c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 -- 172.21.15.100:0/1842663886 shutdown_connections 2024-09-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.152+0000 7f3750840640 1 -- 172.21.15.100:0/1842663886 wait complete. 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 Processor -- start 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 -- start start 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c102da0 0x7f374c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c1036c0 0x7f374c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374c10c180 0x7f374c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f374c111f60 con 0x7f374c1036c0 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f374c111de0 con 0x7f374c10c180 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3750840640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f374c1120e0 con 0x7f374c102da0 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.153+0000 7f3749d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c1036c0 0x7f374c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c1036c0 0x7f374c100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52458/0 (socket says 172.21.15.100:52458) 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 -- 172.21.15.100:0/2075593272 learned_addr learned my addr 172.21.15.100:0/2075593272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f374ad9d640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374c10c180 0x7f374c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f374a59c640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c102da0 0x7f374c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 -- 172.21.15.100:0/2075593272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c102da0 msgr2=0x7f374c100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c102da0 0x7f374c100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 -- 172.21.15.100:0/2075593272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374c10c180 msgr2=0x7f374c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374c10c180 0x7f374c101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 -- 172.21.15.100:0/2075593272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c1a6900 con 0x7f374c1036c0 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f374a59c640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c102da0 0x7f374c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3749d9b640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c1036c0 0x7f374c100f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f374000ebc0 tx=0x7f374000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f373b7fe640 1 -- 172.21.15.100:0/2075593272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740010630 con 0x7f374c1036c0 2024-09-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c1a6bf0 con 0x7f374c1036c0 2024-09-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f373b7fe640 1 -- 172.21.15.100:0/2075593272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3740010cb0 con 0x7f374c1036c0 2024-09-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f373b7fe640 1 -- 172.21.15.100:0/2075593272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740018bd0 con 0x7f374c1036c0 2024-09-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.154+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c1a7180 con 0x7f374c1036c0 2024-09-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.155+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c103180 con 0x7f374c1036c0 2024-09-12T02:04:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.156+0000 7f373b7fe640 1 -- 172.21.15.100:0/2075593272 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f37400107d0 con 0x7f374c1036c0 2024-09-12T02:04:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.157+0000 7f373b7fe640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f37340a2b80 0x7f37340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.157+0000 7f374a59c640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f37340a2b80 0x7f37340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.157+0000 7f373b7fe640 1 -- 172.21.15.100:0/2075593272 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f37400cf1b0 con 0x7f374c1036c0 2024-09-12T02:04:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.157+0000 7f374a59c640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f37340a2b80 0x7f37340a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3744005fd0 tx=0x7f3744005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:37.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.161+0000 7f373b7fe640 1 -- 172.21.15.100:0/2075593272 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f374009c5b0 con 0x7f374c1036c0 2024-09-12T02:04:37.280 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.280 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.280 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: Deploying daemon mds.e on smithi117 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.100:6836/650735571,v1:172.21.15.100:6837/650735571] up:boot 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: fsmap 4 up:standby 2024-09-12T02:04:37.281 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:36 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: Deploying daemon mds.e on smithi117 2024-09-12T02:04:37.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.100:6836/650735571,v1:172.21.15.100:6837/650735571] up:boot 2024-09-12T02:04:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: fsmap 4 up:standby 2024-09-12T02:04:37.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:36 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:04:37.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.372+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f374c107220 con 0x7f374c1036c0 2024-09-12T02:04:37.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.373+0000 7f373b7fe640 1 -- 172.21.15.100:0/2075593272 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f374009beb0 con 0x7f374c1036c0 2024-09-12T02:04:37.373 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:37.373 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"btime":"2024-09-12T02:04:36:072157+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:04:37.373 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 5 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.374+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f37340a2b80 msgr2=0x7f37340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.374+0000 7f3750840640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f37340a2b80 0x7f37340a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3744005fd0 tx=0x7f3744005ea0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.374+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c1036c0 msgr2=0x7f374c100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.374+0000 7f3750840640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c1036c0 0x7f374c100f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f374000ebc0 tx=0x7f374000c6a0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 shutdown_connections 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f37340a2b80 0x7f37340a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374c10c180 0x7f374c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f374c1036c0 0x7f374c100f40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 --2- 172.21.15.100:0/2075593272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f374c102da0 0x7f374c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 >> 172.21.15.100:0/2075593272 conn(0x7f374c0fc7a0 msgr2=0x7f374c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 shutdown_connections 2024-09-12T02:04:37.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:37.375+0000 7f3750840640 1 -- 172.21.15.100:0/2075593272 wait complete. 2024-09-12T02:04:37.900 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:37 smithi117 systemd[1]: Starting Ceph mds.e for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:38.051 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:37 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2075593272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:38.186 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:37 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2075593272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:38.186 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:37 smithi117 podman[65413]: 2024-09-12 02:04:37.858398177 +0000 UTC m=+0.016795185 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:38.186 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:37 smithi117 podman[65413]: 2024-09-12 02:04:37.958066726 +0000 UTC m=+0.116463726 container create 14154e07bc81336436d0dc9bb52c90d4198d483e762c18e67194d9764bb2b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:04:38.186 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:38 smithi117 podman[65413]: 2024-09-12 02:04:38.160656485 +0000 UTC m=+0.319053481 container init 14154e07bc81336436d0dc9bb52c90d4198d483e762c18e67194d9764bb2b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:04:38.186 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:38 smithi117 podman[65413]: 2024-09-12 02:04:38.163569161 +0000 UTC m=+0.321966159 container start 14154e07bc81336436d0dc9bb52c90d4198d483e762c18e67194d9764bb2b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:04:38.187 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mds[65433]: -- 172.21.15.117:0/4085580283 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5579c807d860 con 0x5579c805b000 2024-09-12T02:04:38.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:37 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2075593272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:38.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e[65429]: starting mds.e at 2024-09-12T02:04:38.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:38 smithi117 bash[65413]: 14154e07bc81336436d0dc9bb52c90d4198d483e762c18e67194d9764bb2b3bf 2024-09-12T02:04:38.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:04:38 smithi117 systemd[1]: Started Ceph mds.e for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:39.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:38 smithi189 ceph-mon[35188]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:39.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:39.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:39.021 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:38 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:39.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:38 smithi100 ceph-mon[31179]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:39.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:39.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:39.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:38 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mon[35240]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:38 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:39 smithi189 ceph-mon[35188]: Deploying daemon mds.f on smithi189 2024-09-12T02:04:40.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:39 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6834/3915021752,v1:172.21.15.117:6835/3915021752] up:boot 2024-09-12T02:04:40.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:39 smithi189 ceph-mon[35188]: fsmap 5 up:standby 2024-09-12T02:04:40.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:04:40.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:39 smithi100 ceph-mon[31179]: Deploying daemon mds.f on smithi189 2024-09-12T02:04:40.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:39 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6834/3915021752,v1:172.21.15.117:6835/3915021752] up:boot 2024-09-12T02:04:40.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:39 smithi100 ceph-mon[31179]: fsmap 5 up:standby 2024-09-12T02:04:40.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:04:40.080 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:40.343 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 systemd[1]: Starting Ceph mds.f for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:39 smithi117 ceph-mon[35240]: Deploying daemon mds.f on smithi189 2024-09-12T02:04:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:39 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6834/3915021752,v1:172.21.15.117:6835/3915021752] up:boot 2024-09-12T02:04:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:39 smithi117 ceph-mon[35240]: fsmap 5 up:standby 2024-09-12T02:04:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:04:40.710 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 podman[65850]: 2024-09-12 02:04:40.315483879 +0000 UTC m=+0.016576249 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:40.711 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 podman[65850]: 2024-09-12 02:04:40.443296009 +0000 UTC m=+0.144388366 container create 4a88eac77cc3671466b0e8052d331539d2edc65597d97a923f954f0d660bc385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:04:40.711 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 podman[65850]: 2024-09-12 02:04:40.711341733 +0000 UTC m=+0.412434090 container init 4a88eac77cc3671466b0e8052d331539d2edc65597d97a923f954f0d660bc385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:04:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 -- 172.21.15.100:0/807539185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58100a80 msgr2=0x7f1f58100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 --2- 172.21.15.100:0/807539185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58100a80 0x7f1f58100ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009930 tx=0x7f1f4c02a420 comp rx=0 tx=0).stop 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 -- 172.21.15.100:0/807539185 shutdown_connections 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 --2- 172.21.15.100:0/807539185 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f58101420 0x7f1f5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 --2- 172.21.15.100:0/807539185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58100a80 0x7f1f58100ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 --2- 172.21.15.100:0/807539185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58106a80 0x7f1f58106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 -- 172.21.15.100:0/807539185 >> 172.21.15.100:0/807539185 conn(0x7f1f580fc7a0 msgr2=0x7f1f580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 -- 172.21.15.100:0/807539185 shutdown_connections 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.783+0000 7f1f5de92640 1 -- 172.21.15.100:0/807539185 wait complete. 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 Processor -- start 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 -- start start 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58100a80 0x7f1f58198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f58101420 0x7f1f58198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58106a80 0x7f1f5819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58110e80 con 0x7f1f58106a80 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58110d00 con 0x7f1f58100a80 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f5de92640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58111000 con 0x7f1f58101420 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58106a80 0x7f1f5819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58106a80 0x7f1f5819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52486/0 (socket says 172.21.15.100:52486) 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.784+0000 7f1f57fff640 1 -- 172.21.15.100:0/3657199197 learned_addr learned my addr 172.21.15.100:0/3657199197 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f577fe640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58100a80 0x7f1f58198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f56ffd640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f58101420 0x7f1f58198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f57fff640 1 -- 172.21.15.100:0/3657199197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f58101420 msgr2=0x7f1f58198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f57fff640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f58101420 0x7f1f58198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f57fff640 1 -- 172.21.15.100:0/3657199197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58100a80 msgr2=0x7f1f58198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f57fff640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58100a80 0x7f1f58198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f57fff640 1 -- 172.21.15.100:0/3657199197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5819d3e0 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f577fe640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58100a80 0x7f1f58198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f57fff640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58106a80 0x7f1f5819cd00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000d750 tx=0x7f1f5000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f54ff9640 1 -- 172.21.15.100:0/3657199197 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50017070 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5819d6d0 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f54ff9640 1 -- 172.21.15.100:0/3657199197 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f50005500 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f54ff9640 1 -- 172.21.15.100:0/3657199197 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004d90 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.785+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581a4fb0 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.786+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f58100ee0 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.787+0000 7f1f54ff9640 1 -- 172.21.15.100:0/3657199197 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f1f50005020 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.788+0000 7f1f54ff9640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1f400a2b80 0x7f1f400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.788+0000 7f1f577fe640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1f400a2b80 0x7f1f400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.788+0000 7f1f54ff9640 1 -- 172.21.15.100:0/3657199197 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1f500ce610 con 0x7f1f58106a80 2024-09-12T02:04:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.788+0000 7f1f577fe640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1f400a2b80 0x7f1f400a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f48005c40 tx=0x7f1f48005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.792+0000 7f1f54ff9640 1 -- 172.21.15.100:0/3657199197 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f5009ba10 con 0x7f1f58106a80 2024-09-12T02:04:40.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.997+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f581a51e0 con 0x7f1f58106a80 2024-09-12T02:04:40.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:40 smithi100 ceph-mon[31179]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:40.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:40.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:40.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:40.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:40.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:40.998 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:40 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:40.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.998+0000 7f1f54ff9640 1 -- 172.21.15.100:0/3657199197 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7f1f5009b310 con 0x7f1f58106a80 2024-09-12T02:04:40.999 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:40.999 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"btime":"2024-09-12T02:04:40:931070+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:40.999+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1f400a2b80 msgr2=0x7f1f400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1f400a2b80 0x7f1f400a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f48005c40 tx=0x7f1f48005bd0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58106a80 msgr2=0x7f1f5819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58106a80 0x7f1f5819cd00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000d750 tx=0x7f1f5000dc10 comp rx=0 tx=0).stop 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 shutdown_connections 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1f400a2b80 0x7f1f400a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f58106a80 0x7f1f5819cd00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f58101420 0x7f1f58198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 --2- 172.21.15.100:0/3657199197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58100a80 0x7f1f58198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 >> 172.21.15.100:0/3657199197 conn(0x7f1f580fc7a0 msgr2=0x7f1f58104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 shutdown_connections 2024-09-12T02:04:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:41.000+0000 7f1f5de92640 1 -- 172.21.15.100:0/3657199197 wait complete. 2024-09-12T02:04:41.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mon[35188]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:41.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:41.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:41.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:41.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:41.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:41.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:41.094 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 podman[65850]: 2024-09-12 02:04:40.714171275 +0000 UTC m=+0.415263642 container start 4a88eac77cc3671466b0e8052d331539d2edc65597d97a923f954f0d660bc385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:04:41.094 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-mds[65869]: -- 172.21.15.189:0/665597950 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564609647860 con 0x564609625400 2024-09-12T02:04:41.094 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f[65865]: starting mds.f at 2024-09-12T02:04:41.094 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 bash[65850]: 4a88eac77cc3671466b0e8052d331539d2edc65597d97a923f954f0d660bc385 2024-09-12T02:04:41.094 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:04:40 smithi189 systemd[1]: Started Ceph mds.f for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:40 smithi117 ceph-mon[35240]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:40 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:42.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:41 smithi189 ceph-mon[35188]: Deploying daemon mds.c on smithi189 2024-09-12T02:04:42.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:41 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6834/2566860695,v1:172.21.15.189:6835/2566860695] up:boot 2024-09-12T02:04:42.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:41 smithi189 ceph-mon[35188]: fsmap 6 up:standby 2024-09-12T02:04:42.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:41 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:04:42.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:41 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3657199197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:42.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:41 smithi100 ceph-mon[31179]: Deploying daemon mds.c on smithi189 2024-09-12T02:04:42.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:41 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6834/2566860695,v1:172.21.15.189:6835/2566860695] up:boot 2024-09-12T02:04:42.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:41 smithi100 ceph-mon[31179]: fsmap 6 up:standby 2024-09-12T02:04:42.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:41 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:04:42.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:41 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3657199197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:42.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:41 smithi117 ceph-mon[35240]: Deploying daemon mds.c on smithi189 2024-09-12T02:04:42.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:41 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6834/2566860695,v1:172.21.15.189:6835/2566860695] up:boot 2024-09-12T02:04:42.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:41 smithi117 ceph-mon[35240]: fsmap 6 up:standby 2024-09-12T02:04:42.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:41 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:04:42.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:41 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3657199197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:42.773 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:42 smithi189 systemd[1]: Starting Ceph mds.c for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:43.081 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:42 smithi189 ceph-mon[35188]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:43.081 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:42 smithi189 podman[66150]: 2024-09-12 02:04:42.676079964 +0000 UTC m=+0.015958271 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:43.081 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:42 smithi189 podman[66150]: 2024-09-12 02:04:42.804153651 +0000 UTC m=+0.144032014 container create 71f315c27e5a3536c97317ea46b865e1c6e5620ebb34d5df4bc5263bb0626b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:04:43.081 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:42 smithi189 podman[66150]: 2024-09-12 02:04:42.989843622 +0000 UTC m=+0.329721920 container init 71f315c27e5a3536c97317ea46b865e1c6e5620ebb34d5df4bc5263bb0626b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T02:04:43.082 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:42 smithi189 podman[66150]: 2024-09-12 02:04:42.992906276 +0000 UTC m=+0.332784576 container start 71f315c27e5a3536c97317ea46b865e1c6e5620ebb34d5df4bc5263bb0626b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:04:43.082 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:43 smithi189 ceph-mds[66169]: -- 172.21.15.189:0/3513961640 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c34c59b860 con 0x55c34c579000 2024-09-12T02:04:43.082 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c[66165]: starting mds.c at 2024-09-12T02:04:43.082 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:43 smithi189 bash[66150]: 71f315c27e5a3536c97317ea46b865e1c6e5620ebb34d5df4bc5263bb0626b63 2024-09-12T02:04:43.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:42 smithi100 ceph-mon[31179]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:43.343 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:04:43 smithi189 systemd[1]: Started Ceph mds.c for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:43.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:42 smithi117 ceph-mon[35240]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:43.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:43.911 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: Deploying daemon mds.h on smithi117 2024-09-12T02:04:44.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6836/3569067822,v1:172.21.15.189:6837/3569067822] up:boot 2024-09-12T02:04:44.288 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: fsmap 7 up:standby 2024-09-12T02:04:44.288 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:44 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:04:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3959686259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 msgr2=0x7fe8e0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3959686259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0100ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009930 tx=0x7fe8c802a420 comp rx=0 tx=0).stop 2024-09-12T02:04:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3959686259 shutdown_connections 2024-09-12T02:04:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3959686259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e0101420 0x7fe8e010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3959686259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0100ee0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3959686259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0106a80 0x7fe8e0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3959686259 >> 172.21.15.100:0/3959686259 conn(0x7fe8e00fc7a0 msgr2=0x7fe8e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3959686259 shutdown_connections 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3959686259 wait complete. 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 Processor -- start 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.366+0000 7fe8e58b4640 1 -- start start 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e0101420 0x7fe8e0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0106a80 0x7fe8e019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e0111f60 con 0x7fe8e0100a80 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e0111de0 con 0x7fe8e0106a80 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01120e0 con 0x7fe8e0101420 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50846/0 (socket says 172.21.15.100:50846) 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 -- 172.21.15.100:0/3077893040 learned_addr learned my addr 172.21.15.100:0/3077893040 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8df7fe640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0106a80 0x7fe8e019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 -- 172.21.15.100:0/3077893040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e0101420 msgr2=0x7fe8e0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e0101420 0x7fe8e0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 -- 172.21.15.100:0/3077893040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0106a80 msgr2=0x7fe8e019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0106a80 0x7fe8e019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 -- 172.21.15.100:0/3077893040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e019d3b0 con 0x7fe8e0100a80 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8deffd640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0198400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c920 tx=0x7fe8d000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e48b2640 1 -- 172.21.15.100:0/3077893040 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0007c70 con 0x7fe8e0100a80 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e48b2640 1 -- 172.21.15.100:0/3077893040 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d0007e10 con 0x7fe8e0100a80 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e48b2640 1 -- 172.21.15.100:0/3077893040 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0018890 con 0x7fe8e0100a80 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e019d6a0 con 0x7fe8e0100a80 2024-09-12T02:04:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.367+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e01a4f80 con 0x7fe8e0100a80 2024-09-12T02:04:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.368+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e0100ee0 con 0x7fe8e0100a80 2024-09-12T02:04:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.369+0000 7fe8e48b2640 1 -- 172.21.15.100:0/3077893040 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe8d0018a70 con 0x7fe8e0100a80 2024-09-12T02:04:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.370+0000 7fe8e48b2640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.370+0000 7fe8d7fff640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.370+0000 7fe8e48b2640 1 -- 172.21.15.100:0/3077893040 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe8d00ced20 con 0x7fe8e0100a80 2024-09-12T02:04:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.371+0000 7fe8d7fff640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8c802a940 tx=0x7fe8c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.374+0000 7fe8e48b2640 1 -- 172.21.15.100:0/3077893040 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8d0014030 con 0x7fe8e0100a80 2024-09-12T02:04:44.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: Deploying daemon mds.h on smithi117 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6836/3569067822,v1:172.21.15.189:6837/3569067822] up:boot 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: fsmap 7 up:standby 2024-09-12T02:04:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:44 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:04:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.578+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8e0199760 con 0x7fe8e0100a80 2024-09-12T02:04:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.578+0000 7fe8e48b2640 1 -- 172.21.15.100:0/3077893040 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6400 (secure 0 0 0) 0x7fe8d009c120 con 0x7fe8e0100a80 2024-09-12T02:04:44.578 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:44.579 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"btime":"2024-09-12T02:04:43:946432+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T02:04:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8cc0a2b80 msgr2=0x7fe8cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8c802a940 tx=0x7fe8c8000bc0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 msgr2=0x7fe8e0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0198400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c920 tx=0x7fe8d000cde0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 shutdown_connections 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8cc0a2b80 0x7fe8cc0a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8e0106a80 0x7fe8e019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8e0101420 0x7fe8e0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 --2- 172.21.15.100:0/3077893040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0100a80 0x7fe8e0198400 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.580+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 >> 172.21.15.100:0/3077893040 conn(0x7fe8e00fc7a0 msgr2=0x7fe8e00fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.581+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 shutdown_connections 2024-09-12T02:04:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:44.581+0000 7fe8e58b4640 1 -- 172.21.15.100:0/3077893040 wait complete. 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: Deploying daemon mds.h on smithi117 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6836/3569067822,v1:172.21.15.189:6837/3569067822] up:boot 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: fsmap 7 up:standby 2024-09-12T02:04:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:44 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:04:45.134 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 systemd[1]: Starting Ceph mds.h for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:45 smithi117 ceph-mon[35240]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:45 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3077893040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:45.400 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 podman[65713]: 2024-09-12 02:04:45.219616726 +0000 UTC m=+0.100614694 container create 07958c8f856c8f5f9ffbfbf86cb2109996ae7eda5635bb466627c71039fb5a1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:04:45.400 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 podman[65713]: 2024-09-12 02:04:45.13498027 +0000 UTC m=+0.015978204 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:45.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:45 smithi100 ceph-mon[31179]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:45.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:45 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3077893040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:45.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:45 smithi189 ceph-mon[35188]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:45.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:45 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3077893040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:45.900 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 podman[65713]: 2024-09-12 02:04:45.433419413 +0000 UTC m=+0.314417332 container init 07958c8f856c8f5f9ffbfbf86cb2109996ae7eda5635bb466627c71039fb5a1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:04:45.900 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 podman[65713]: 2024-09-12 02:04:45.436223447 +0000 UTC m=+0.317221374 container start 07958c8f856c8f5f9ffbfbf86cb2109996ae7eda5635bb466627c71039fb5a1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T02:04:45.900 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 ceph-mds[65732]: -- 172.21.15.117:0/4235027051 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b40480f860 con 0x55b4047ed400 2024-09-12T02:04:45.900 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h[65728]: starting mds.h at 2024-09-12T02:04:45.900 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 bash[65713]: 07958c8f856c8f5f9ffbfbf86cb2109996ae7eda5635bb466627c71039fb5a1b 2024-09-12T02:04:45.900 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:04:45 smithi117 systemd[1]: Started Ceph mds.h for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: Deploying daemon mds.i on smithi189 2024-09-12T02:04:46.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:46.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] up:boot 2024-09-12T02:04:46.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: fsmap 8 up:standby 2024-09-12T02:04:46.844 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:46 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:04:46.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:46.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:46.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:46.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:46.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:46.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:46.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: Deploying daemon mds.i on smithi189 2024-09-12T02:04:46.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:46.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] up:boot 2024-09-12T02:04:46.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: fsmap 8 up:standby 2024-09-12T02:04:46.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:46 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: Deploying daemon mds.i on smithi189 2024-09-12T02:04:47.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] up:boot 2024-09-12T02:04:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: fsmap 8 up:standby 2024-09-12T02:04:47.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:46 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:04:47.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:47.539 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:47.593 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 systemd[1]: Starting Ceph mds.i for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:47.958 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 podman[66450]: 2024-09-12 02:04:47.556124199 +0000 UTC m=+0.016078295 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:47.958 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 podman[66450]: 2024-09-12 02:04:47.664731314 +0000 UTC m=+0.124685442 container create aa2da3149152ddffffd8547ca70a27fe2e82b6095ff8124da66e714ff9d027b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:04:47.958 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 podman[66450]: 2024-09-12 02:04:47.866908169 +0000 UTC m=+0.326862252 container init aa2da3149152ddffffd8547ca70a27fe2e82b6095ff8124da66e714ff9d027b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:04:47.958 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 podman[66450]: 2024-09-12 02:04:47.869744109 +0000 UTC m=+0.329698197 container start aa2da3149152ddffffd8547ca70a27fe2e82b6095ff8124da66e714ff9d027b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:04:47.958 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 ceph-mds[66470]: -- 172.21.15.189:0/1625632689 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ecf5ab5860 con 0x55ecf5a92800 2024-09-12T02:04:47.958 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i[66466]: starting mds.i at 2024-09-12T02:04:47.959 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 bash[66450]: aa2da3149152ddffffd8547ca70a27fe2e82b6095ff8124da66e714ff9d027b4 2024-09-12T02:04:47.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 -- 172.21.15.100:0/2391578541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434101de0 msgr2=0x7fb4341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/2391578541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434101de0 0x7fb4341021c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb424009900 tx=0x7fb42402a410 comp rx=0 tx=0).stop 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 -- 172.21.15.100:0/2391578541 shutdown_connections 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/2391578541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb434106f10 0x7fb43410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/2391578541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb434102790 0x7fb4341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/2391578541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434101de0 0x7fb4341021c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 -- 172.21.15.100:0/2391578541 >> 172.21.15.100:0/2391578541 conn(0x7fb4340fd8c0 msgr2=0x7fb4340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 -- 172.21.15.100:0/2391578541 shutdown_connections 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.992+0000 7fb43b1ba640 1 -- 172.21.15.100:0/2391578541 wait complete. 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 Processor -- start 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 -- start start 2024-09-12T02:04:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb434101de0 0x7fb434198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb434102790 0x7fb4341988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434106f10 0x7fb43419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb434111f70 con 0x7fb434106f10 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb434111df0 con 0x7fb434101de0 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb43b1ba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341120f0 con 0x7fb434102790 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434106f10 0x7fb43419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434106f10 0x7fb43419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50856/0 (socket says 172.21.15.100:50856) 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 -- 172.21.15.100:0/1536253841 learned_addr learned my addr 172.21.15.100:0/1536253841 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb433fff640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb434102790 0x7fb4341988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb438f56640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb434101de0 0x7fb434198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 -- 172.21.15.100:0/1536253841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb434102790 msgr2=0x7fb4341988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb434102790 0x7fb4341988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 -- 172.21.15.100:0/1536253841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb434101de0 msgr2=0x7fb434198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb434101de0 0x7fb434198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.993+0000 7fb439757640 1 -- 172.21.15.100:0/1536253841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43419d320 con 0x7fb434106f10 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.994+0000 7fb439757640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434106f10 0x7fb43419cc40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00eaa0 tx=0x7fb42c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.994+0000 7fb431ffb640 1 -- 172.21.15.100:0/1536253841 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c004d20 con 0x7fb434106f10 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.994+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43419d610 con 0x7fb434106f10 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.994+0000 7fb431ffb640 1 -- 172.21.15.100:0/1536253841 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb42c005020 con 0x7fb434106f10 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.994+0000 7fb431ffb640 1 -- 172.21.15.100:0/1536253841 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c0116d0 con 0x7fb434106f10 2024-09-12T02:04:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.994+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4341a4ef0 con 0x7fb434106f10 2024-09-12T02:04:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.995+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4341021c0 con 0x7fb434106f10 2024-09-12T02:04:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.996+0000 7fb431ffb640 1 -- 172.21.15.100:0/1536253841 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb42c0051d0 con 0x7fb434106f10 2024-09-12T02:04:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.997+0000 7fb431ffb640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb41c0a2b80 0x7fb41c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.997+0000 7fb438f56640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb41c0a2b80 0x7fb41c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.997+0000 7fb431ffb640 1 -- 172.21.15.100:0/1536253841 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb42c0ced10 con 0x7fb434106f10 2024-09-12T02:04:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:47.997+0000 7fb438f56640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb41c0a2b80 0x7fb41c0a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb424005ab0 tx=0x7fb424005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.001+0000 7fb431ffb640 1 -- 172.21.15.100:0/1536253841 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb42c016030 con 0x7fb434106f10 2024-09-12T02:04:48.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.209+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb43410a150 con 0x7fb434106f10 2024-09-12T02:04:48.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.210+0000 7fb431ffb640 1 -- 172.21.15.100:0/1536253841 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8055 (secure 0 0 0) 0x7fb42c09c110 con 0x7fb434106f10 2024-09-12T02:04:48.210 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:48.210 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"btime":"2024-09-12T02:04:47:948924+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24433,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:04:48.210 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 10 2024-09-12T02:04:48.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb41c0a2b80 msgr2=0x7fb41c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb41c0a2b80 0x7fb41c0a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb424005ab0 tx=0x7fb424005a20 comp rx=0 tx=0).stop 2024-09-12T02:04:48.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434106f10 msgr2=0x7fb43419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434106f10 0x7fb43419cc40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00eaa0 tx=0x7fb42c00eea0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 shutdown_connections 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb41c0a2b80 0x7fb41c0a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb434106f10 0x7fb43419cc40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb434102790 0x7fb4341988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 --2- 172.21.15.100:0/1536253841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb434101de0 0x7fb434198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 >> 172.21.15.100:0/1536253841 conn(0x7fb4340fd8c0 msgr2=0x7fb4340fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 shutdown_connections 2024-09-12T02:04:48.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:48.212+0000 7fb43b1ba640 1 -- 172.21.15.100:0/1536253841 wait complete. 2024-09-12T02:04:48.343 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:04:47 smithi189 systemd[1]: Started Ceph mds.i for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:49.310 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] up:boot 2024-09-12T02:04:49.310 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: fsmap 9 up:standby 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: Deploying daemon mds.g on smithi100 2024-09-12T02:04:49.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:48 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1536253841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] up:boot 2024-09-12T02:04:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: fsmap 9 up:standby 2024-09-12T02:04:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:04:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:49.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:49.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:49.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: Deploying daemon mds.g on smithi100 2024-09-12T02:04:49.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:48 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1536253841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] up:boot 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: fsmap 9 up:standby 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:49.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:49.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:49.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: Deploying daemon mds.g on smithi100 2024-09-12T02:04:49.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:48 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1536253841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:50.569 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 systemd[1]: Starting Ceph mds.g for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:50.872 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 podman[71376]: 2024-09-12 02:04:50.506181883 +0000 UTC m=+0.015848633 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:50.872 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 podman[71376]: 2024-09-12 02:04:50.619022775 +0000 UTC m=+0.128689511 container create 436c8e523b0cd48ede898e3bd52ac8db746976c04463086d515b08c33408ed13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:04:50.872 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 podman[71376]: 2024-09-12 02:04:50.846394499 +0000 UTC m=+0.356061236 container init 436c8e523b0cd48ede898e3bd52ac8db746976c04463086d515b08c33408ed13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T02:04:50.872 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 podman[71376]: 2024-09-12 02:04:50.849224477 +0000 UTC m=+0.358891214 container start 436c8e523b0cd48ede898e3bd52ac8db746976c04463086d515b08c33408ed13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:04:50.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:51.149 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:51.270 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:51 smithi100 ceph-mon[31179]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:51.270 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.270 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.270 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.270 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:51.270 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:51.270 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:51 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:51.271 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 ceph-mds[71395]: -- 172.21.15.100:0/2606602896 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef3dc1b860 con 0x55ef3dbf9000 2024-09-12T02:04:51.271 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g[71391]: starting mds.g at 2024-09-12T02:04:51.271 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 bash[71376]: 436c8e523b0cd48ede898e3bd52ac8db746976c04463086d515b08c33408ed13 2024-09-12T02:04:51.271 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:04:50 smithi100 systemd[1]: Started Ceph mds.g for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:51 smithi189 ceph-mon[35188]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:51.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:51 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:51.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:51 smithi117 ceph-mon[35240]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:51 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 -- 172.21.15.100:0/2996697363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87301036e0 msgr2=0x7f8730107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 --2- 172.21.15.100:0/2996697363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87301036e0 0x7f8730107b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8724009930 tx=0x7f872402a420 comp rx=0 tx=0).stop 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 -- 172.21.15.100:0/2996697363 shutdown_connections 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 --2- 172.21.15.100:0/2996697363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87301082a0 0x7f873010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 --2- 172.21.15.100:0/2996697363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87301036e0 0x7f8730107b90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 --2- 172.21.15.100:0/2996697363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8730102d30 0x7f8730103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 -- 172.21.15.100:0/2996697363 >> 172.21.15.100:0/2996697363 conn(0x7f87300fc7d0 msgr2=0x7f87300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 -- 172.21.15.100:0/2996697363 shutdown_connections 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 -- 172.21.15.100:0/2996697363 wait complete. 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.597+0000 7f8736563640 1 Processor -- start 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8736563640 1 -- start start 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8736563640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8730102d30 0x7f8730100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8736563640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87301036e0 0x7f8730100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8736563640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87301082a0 0x7f8730101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8736563640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f87301120a0 con 0x7f8730102d30 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8736563640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8730111f20 con 0x7f87301036e0 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8736563640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112220 con 0x7f87301082a0 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8730102d30 0x7f8730100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8730102d30 0x7f8730100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50892/0 (socket says 172.21.15.100:50892) 2024-09-12T02:04:51.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 -- 172.21.15.100:0/861004126 learned_addr learned my addr 172.21.15.100:0/861004126 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872f7fe640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87301036e0 0x7f8730100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 -- 172.21.15.100:0/861004126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87301082a0 msgr2=0x7f8730101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8734b00640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87301082a0 0x7f8730101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87301082a0 0x7f8730101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 -- 172.21.15.100:0/861004126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87301036e0 msgr2=0x7f8730100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87301036e0 0x7f8730100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 -- 172.21.15.100:0/861004126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87301a6aa0 con 0x7f8730102d30 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872f7fe640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87301036e0 0x7f8730100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f8734b00640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87301082a0 0x7f8730101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.598+0000 7f872ffff640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8730102d30 0x7f8730100990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f872000d770 tx=0x7f872000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.599+0000 7f872d7fa640 1 -- 172.21.15.100:0/861004126 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720017070 con 0x7f8730102d30 2024-09-12T02:04:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.599+0000 7f872d7fa640 1 -- 172.21.15.100:0/861004126 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8720005500 con 0x7f8730102d30 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.599+0000 7f872d7fa640 1 -- 172.21.15.100:0/861004126 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720004e00 con 0x7f8730102d30 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.599+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87301a6d90 con 0x7f8730102d30 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.599+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301a7220 con 0x7f8730102d30 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.600+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8730103110 con 0x7f8730102d30 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.601+0000 7f872d7fa640 1 -- 172.21.15.100:0/861004126 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8720004fa0 con 0x7f8730102d30 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.601+0000 7f872d7fa640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f87180a2b80 0x7f87180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.602+0000 7f872f7fe640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f87180a2b80 0x7f87180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.602+0000 7f872d7fa640 1 -- 172.21.15.100:0/861004126 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f87200cea80 con 0x7f8730102d30 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.602+0000 7f872f7fe640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f87180a2b80 0x7f87180a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f872402a940 tx=0x7f8724032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.605+0000 7f872d7fa640 1 -- 172.21.15.100:0/861004126 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f872009be80 con 0x7f8730102d30 2024-09-12T02:04:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.815+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8730101ec0 con 0x7f8730102d30 2024-09-12T02:04:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.816+0000 7f872d7fa640 1 -- 172.21.15.100:0/861004126 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8884 (secure 0 0 0) 0x7f872009b780 con 0x7f8730102d30 2024-09-12T02:04:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:51.817 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":11,"btime":"2024-09-12T02:04:51:063605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24433,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:04:51.817 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 11 2024-09-12T02:04:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f87180a2b80 msgr2=0x7f87180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f87180a2b80 0x7f87180a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f872402a940 tx=0x7f8724032c70 comp rx=0 tx=0).stop 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8730102d30 msgr2=0x7f8730100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8730102d30 0x7f8730100990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f872000d770 tx=0x7f872000dc30 comp rx=0 tx=0).stop 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 shutdown_connections 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f87180a2b80 0x7f87180a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87301082a0 0x7f8730101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87301036e0 0x7f8730100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 --2- 172.21.15.100:0/861004126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8730102d30 0x7f8730100990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 >> 172.21.15.100:0/861004126 conn(0x7f87300fc7d0 msgr2=0x7f8730105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 shutdown_connections 2024-09-12T02:04:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:51.818+0000 7f8736563640 1 -- 172.21.15.100:0/861004126 wait complete. 2024-09-12T02:04:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:52 smithi189 ceph-mon[35188]: Deploying daemon mds.a on smithi100 2024-09-12T02:04:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:52 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.100:6838/3243845929,v1:172.21.15.100:6839/3243845929] up:boot 2024-09-12T02:04:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:52 smithi189 ceph-mon[35188]: fsmap 10 up:standby 2024-09-12T02:04:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:52 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:04:52.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:52 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/861004126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:52.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:52 smithi100 ceph-mon[31179]: Deploying daemon mds.a on smithi100 2024-09-12T02:04:52.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:52 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.100:6838/3243845929,v1:172.21.15.100:6839/3243845929] up:boot 2024-09-12T02:04:52.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:52 smithi100 ceph-mon[31179]: fsmap 10 up:standby 2024-09-12T02:04:52.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:52 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:04:52.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:52 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/861004126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:52 smithi117 ceph-mon[35240]: Deploying daemon mds.a on smithi100 2024-09-12T02:04:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:52 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.100:6838/3243845929,v1:172.21.15.100:6839/3243845929] up:boot 2024-09-12T02:04:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:52 smithi117 ceph-mon[35240]: fsmap 10 up:standby 2024-09-12T02:04:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:52 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:04:52.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:52 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/861004126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:53.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:53 smithi100 ceph-mon[31179]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:53.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:53 smithi189 ceph-mon[35188]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:53 smithi117 ceph-mon[35240]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:54.069 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:53 smithi100 systemd[1]: Starting Ceph mds.a for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:54.367 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 podman[71795]: 2024-09-12 02:04:54.105464397 +0000 UTC m=+0.101028818 container create 3627d61471d62c94c59c5e8cc448bcd10b264f1d501b3ec49aceccefb8688d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:04:54.367 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 podman[71795]: 2024-09-12 02:04:54.020301695 +0000 UTC m=+0.015866125 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:54.367 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 podman[71795]: 2024-09-12 02:04:54.341730253 +0000 UTC m=+0.337294686 container init 3627d61471d62c94c59c5e8cc448bcd10b264f1d501b3ec49aceccefb8688d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:04:54.367 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 podman[71795]: 2024-09-12 02:04:54.344569947 +0000 UTC m=+0.340134371 container start 3627d61471d62c94c59c5e8cc448bcd10b264f1d501b3ec49aceccefb8688d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:04:54.818 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 ceph-mds[71814]: -- 172.21.15.100:0/3701214278 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560dddf89860 con 0x560dddf66800 2024-09-12T02:04:54.819 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a[71810]: starting mds.a at 2024-09-12T02:04:54.819 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 bash[71795]: 3627d61471d62c94c59c5e8cc448bcd10b264f1d501b3ec49aceccefb8688d0e 2024-09-12T02:04:54.819 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:04:54 smithi100 systemd[1]: Started Ceph mds.a for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:55.012 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:55.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:55 smithi117 ceph-mon[35240]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:55.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:55.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:55.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:55 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:55.274 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:55.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:55 smithi100 ceph-mon[31179]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:55 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:55 smithi189 ceph-mon[35188]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:04:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:04:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:55 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:55.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.739+0000 7f2f90af2640 1 -- 172.21.15.100:0/4267965418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c101de0 msgr2=0x7f2f8c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.739+0000 7f2f90af2640 1 --2- 172.21.15.100:0/4267965418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c101de0 0x7f2f8c1021c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009900 tx=0x7f2f7c02a410 comp rx=0 tx=0).stop 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.739+0000 7f2f90af2640 1 -- 172.21.15.100:0/4267965418 shutdown_connections 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.739+0000 7f2f90af2640 1 --2- 172.21.15.100:0/4267965418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f8c106f10 0x7f2f8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.739+0000 7f2f90af2640 1 --2- 172.21.15.100:0/4267965418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f8c102790 0x7f2f8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.739+0000 7f2f90af2640 1 --2- 172.21.15.100:0/4267965418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c101de0 0x7f2f8c1021c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.740+0000 7f2f90af2640 1 -- 172.21.15.100:0/4267965418 >> 172.21.15.100:0/4267965418 conn(0x7f2f8c0fd8c0 msgr2=0x7f2f8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.740+0000 7f2f90af2640 1 -- 172.21.15.100:0/4267965418 shutdown_connections 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.740+0000 7f2f90af2640 1 -- 172.21.15.100:0/4267965418 wait complete. 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.740+0000 7f2f90af2640 1 Processor -- start 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f90af2640 1 -- start start 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f90af2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f8c101de0 0x7f2f8c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f90af2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f8c102790 0x7f2f8c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f90af2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c106f10 0x7f2f8c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f90af2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c111f30 con 0x7f2f8c106f10 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f90af2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c111db0 con 0x7f2f8c102790 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f90af2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c1120b0 con 0x7f2f8c101de0 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c106f10 0x7f2f8c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c106f10 0x7f2f8c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58860/0 (socket says 172.21.15.100:58860) 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 -- 172.21.15.100:0/3164298101 learned_addr learned my addr 172.21.15.100:0/3164298101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f81d9b640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f8c102790 0x7f2f8c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8a59c640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f8c101de0 0x7f2f8c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 -- 172.21.15.100:0/3164298101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f8c101de0 msgr2=0x7f2f8c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f8c101de0 0x7f2f8c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 -- 172.21.15.100:0/3164298101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f8c102790 msgr2=0x7f2f8c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f8c102790 0x7f2f8c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 -- 172.21.15.100:0/3164298101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c19d3f0 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.741+0000 7f2f8ad9d640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c106f10 0x7f2f8c19cd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400cad0 tx=0x7f2f8400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.742+0000 7f2f83fff640 1 -- 172.21.15.100:0/3164298101 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400ae20 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.742+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8c19d6e0 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.742+0000 7f2f83fff640 1 -- 172.21.15.100:0/3164298101 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f84005020 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.742+0000 7f2f83fff640 1 -- 172.21.15.100:0/3164298101 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400f6f0 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.742+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8c1a4fc0 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.743+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f8c1021c0 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.744+0000 7f2f83fff640 1 -- 172.21.15.100:0/3164298101 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2f840051d0 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.745+0000 7f2f83fff640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2f780a2b80 0x7f2f780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.745+0000 7f2f8a59c640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2f780a2b80 0x7f2f780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.745+0000 7f2f83fff640 1 -- 172.21.15.100:0/3164298101 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f2f840cec80 con 0x7f2f8c106f10 2024-09-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.745+0000 7f2f8a59c640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2f780a2b80 0x7f2f780a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0096c0 tx=0x7f2f7c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.749+0000 7f2f83fff640 1 -- 172.21.15.100:0/3164298101 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f84014030 con 0x7f2f8c106f10 2024-09-12T02:04:55.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.952+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f8c109b60 con 0x7f2f8c106f10 2024-09-12T02:04:55.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.953+0000 7f2f83fff640 1 -- 172.21.15.100:0/3164298101 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9713 (secure 0 0 0) 0x7f2f8409c080 con 0x7f2f8c106f10 2024-09-12T02:04:55.954 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:55.954 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":12,"btime":"2024-09-12T02:04:55:080760+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24433,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:04:55.954 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 12 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2f780a2b80 msgr2=0x7f2f780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2f780a2b80 0x7f2f780a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0096c0 tx=0x7f2f7c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c106f10 msgr2=0x7f2f8c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c106f10 0x7f2f8c19cd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400cad0 tx=0x7f2f8400cf90 comp rx=0 tx=0).stop 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 shutdown_connections 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2f780a2b80 0x7f2f780a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f8c106f10 0x7f2f8c19cd10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f8c102790 0x7f2f8c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 --2- 172.21.15.100:0/3164298101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f8c101de0 0x7f2f8c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 >> 172.21.15.100:0/3164298101 conn(0x7f2f8c0fd8c0 msgr2=0x7f2f8c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:55.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 shutdown_connections 2024-09-12T02:04:55.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:55.955+0000 7f2f90af2640 1 -- 172.21.15.100:0/3164298101 wait complete. 2024-09-12T02:04:56.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:56 smithi100 ceph-mon[31179]: Deploying daemon mds.b on smithi117 2024-09-12T02:04:56.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:56 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.100:6840/1518201039,v1:172.21.15.100:6841/1518201039] up:boot 2024-09-12T02:04:56.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:56 smithi100 ceph-mon[31179]: fsmap 11 up:standby 2024-09-12T02:04:56.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:56 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:04:56.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:56 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3164298101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:56.332 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:56 smithi117 ceph-mon[35240]: Deploying daemon mds.b on smithi117 2024-09-12T02:04:56.332 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:56 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.100:6840/1518201039,v1:172.21.15.100:6841/1518201039] up:boot 2024-09-12T02:04:56.332 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:56 smithi117 ceph-mon[35240]: fsmap 11 up:standby 2024-09-12T02:04:56.333 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:56 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:04:56.333 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:56 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3164298101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:56 smithi189 ceph-mon[35188]: Deploying daemon mds.b on smithi117 2024-09-12T02:04:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:56 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.100:6840/1518201039,v1:172.21.15.100:6841/1518201039] up:boot 2024-09-12T02:04:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:56 smithi189 ceph-mon[35188]: fsmap 11 up:standby 2024-09-12T02:04:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:56 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:04:56.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:56 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3164298101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:04:56.649 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:56 smithi117 systemd[1]: Starting Ceph mds.b for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:04:57.057 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:56 smithi117 podman[66013]: 2024-09-12 02:04:56.63245512 +0000 UTC m=+0.015877483 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:57.057 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:56 smithi117 podman[66013]: 2024-09-12 02:04:56.738332827 +0000 UTC m=+0.121755190 container create ed4b3baae4f406e569fde5d1dd6ac1d9246bb4920812fb4e2af1ba652edd5e92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:04:57.057 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:56 smithi117 podman[66013]: 2024-09-12 02:04:56.948950363 +0000 UTC m=+0.332372727 container init ed4b3baae4f406e569fde5d1dd6ac1d9246bb4920812fb4e2af1ba652edd5e92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:04:57.057 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:56 smithi117 podman[66013]: 2024-09-12 02:04:56.951770238 +0000 UTC m=+0.335192602 container start ed4b3baae4f406e569fde5d1dd6ac1d9246bb4920812fb4e2af1ba652edd5e92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:04:57.058 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:56 smithi117 ceph-mds[66033]: -- 172.21.15.117:0/1204160430 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55daf844d860 con 0x55daf842b000 2024-09-12T02:04:57.058 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:56 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: starting mds.b at 2024-09-12T02:04:57.058 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:57 smithi117 bash[66013]: ed4b3baae4f406e569fde5d1dd6ac1d9246bb4920812fb4e2af1ba652edd5e92 2024-09-12T02:04:57.400 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:04:57 smithi117 systemd[1]: Started Ceph mds.b for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:04:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:57 smithi117 ceph-mon[35240]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:57.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:57 smithi100 ceph-mon[31179]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:57.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:57 smithi189 ceph-mon[35188]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] up:boot 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: fsmap 12 up:standby 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:58 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:58.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] up:boot 2024-09-12T02:04:58.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: fsmap 12 up:standby 2024-09-12T02:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:58 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:58.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:04:58.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] up:boot 2024-09-12T02:04:58.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: fsmap 12 up:standby 2024-09-12T02:04:58.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:04:58.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:58.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:58 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:58.824 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.207 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:59.208 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:59.208 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.208 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:04:59 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:59.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 -- 172.21.15.100:0/3493830048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64102570 msgr2=0x7efc641029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3493830048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64102570 0x7efc641029b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc58009890 tx=0x7efc5802a410 comp rx=0 tx=0).stop 2024-09-12T02:04:59.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 -- 172.21.15.100:0/3493830048 shutdown_connections 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3493830048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc64102ef0 0x7efc6410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3493830048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64102570 0x7efc641029b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3493830048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc64100e20 0x7efc64101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 -- 172.21.15.100:0/3493830048 >> 172.21.15.100:0/3493830048 conn(0x7efc640fc7d0 msgr2=0x7efc640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 -- 172.21.15.100:0/3493830048 shutdown_connections 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.288+0000 7efc6a12f640 1 -- 172.21.15.100:0/3493830048 wait complete. 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 Processor -- start 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 -- start start 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64100e20 0x7efc64197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc64102570 0x7efc64197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc64102ef0 0x7efc6419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc64110f80 con 0x7efc64102ef0 2024-09-12T02:04:59.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc64110e00 con 0x7efc64100e20 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.289+0000 7efc6a12f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efc64111100 con 0x7efc64102570 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc63fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc64102ef0 0x7efc6419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc63fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc64102ef0 0x7efc6419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58888/0 (socket says 172.21.15.100:58888) 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc62ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc64102570 0x7efc64197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc63fff640 1 -- 172.21.15.100:0/3966214263 learned_addr learned my addr 172.21.15.100:0/3966214263 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc637fe640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64100e20 0x7efc64197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc62ffd640 1 -- 172.21.15.100:0/3966214263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64100e20 msgr2=0x7efc64197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc62ffd640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64100e20 0x7efc64197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc62ffd640 1 -- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc64102ef0 msgr2=0x7efc6419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc62ffd640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc64102ef0 0x7efc6419bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc62ffd640 1 -- 172.21.15.100:0/3966214263 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6419c3f0 con 0x7efc64102570 2024-09-12T02:04:59.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc62ffd640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc64102570 0x7efc64197980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc58034000 tx=0x7efc580305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc60ff9640 1 -- 172.21.15.100:0/3966214263 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58005250 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc60ff9640 1 -- 172.21.15.100:0/3966214263 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc580318e0 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6419c680 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc60ff9640 1 -- 172.21.15.100:0/3966214263 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58004bd0 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.290+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc641a3fc0 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.291+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc64101200 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.292+0000 7efc60ff9640 1 -- 172.21.15.100:0/3966214263 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7efc58039040 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.293+0000 7efc60ff9640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efc4c0a2b80 0x7efc4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.293+0000 7efc637fe640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efc4c0a2b80 0x7efc4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.293+0000 7efc60ff9640 1 -- 172.21.15.100:0/3966214263 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7efc580ef840 con 0x7efc64102570 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.293+0000 7efc637fe640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efc4c0a2b80 0x7efc4c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc54005fd0 tx=0x7efc54009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:59.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.297+0000 7efc60ff9640 1 -- 172.21.15.100:0/3966214263 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc58040030 con 0x7efc64102570 2024-09-12T02:04:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:59.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:59.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:04:59 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:59.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.515+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc64109090 con 0x7efc64102570 2024-09-12T02:04:59.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.516+0000 7efc60ff9640 1 -- 172.21.15.100:0/3966214263 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10542 (secure 0 0 0) 0x7efc580bccd0 con 0x7efc64102570 2024-09-12T02:04:59.517 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:04:59.517 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"btime":"2024-09-12T02:04:57:091483+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24433,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T02:04:59.518 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2024-09-12T02:04:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efc4c0a2b80 msgr2=0x7efc4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efc4c0a2b80 0x7efc4c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc54005fd0 tx=0x7efc54009260 comp rx=0 tx=0).stop 2024-09-12T02:04:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc64102570 msgr2=0x7efc64197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc64102570 0x7efc64197980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc58034000 tx=0x7efc580305d0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 shutdown_connections 2024-09-12T02:04:59.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efc4c0a2b80 0x7efc4c0a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc64102ef0 0x7efc6419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc64102570 0x7efc64197980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 --2- 172.21.15.100:0/3966214263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc64100e20 0x7efc64197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 >> 172.21.15.100:0/3966214263 conn(0x7efc640fc7d0 msgr2=0x7efc641048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 shutdown_connections 2024-09-12T02:04:59.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:04:59.518+0000 7efc6a12f640 1 -- 172.21.15.100:0/3966214263 wait complete. 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:04:59.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:04:59 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:00.391 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:00 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3966214263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:05:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:00 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3966214263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:05:00.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:00 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3966214263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:05:00.668 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T02:05:00.954 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:01.353 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:01 smithi100 ceph-mon[31179]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:01.353 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.353 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.353 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.353 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:01 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:01 smithi117 ceph-mon[35240]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:01 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 -- 172.21.15.100:0/2121258823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac102570 msgr2=0x7f73ac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/2121258823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac102570 0x7f73ac1029b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7394009900 tx=0x7f739402a480 comp rx=0 tx=0).stop 2024-09-12T02:05:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 -- 172.21.15.100:0/2121258823 shutdown_connections 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/2121258823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73ac102ef0 0x7f73ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/2121258823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac102570 0x7f73ac1029b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/2121258823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73ac100e20 0x7f73ac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 -- 172.21.15.100:0/2121258823 >> 172.21.15.100:0/2121258823 conn(0x7f73ac0fc7d0 msgr2=0x7f73ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 -- 172.21.15.100:0/2121258823 shutdown_connections 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 -- 172.21.15.100:0/2121258823 wait complete. 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.438+0000 7f73b0b9f640 1 Processor -- start 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 -- start start 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac100e20 0x7f73ac1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73ac102570 0x7f73ac199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73ac102ef0 0x7f73ac1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac110fa0 con 0x7f73ac100e20 2024-09-12T02:05:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac110e20 con 0x7f73ac102570 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac111120 con 0x7f73ac102ef0 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac100e20 0x7f73ac1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac100e20 0x7f73ac1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58906/0 (socket says 172.21.15.100:58906) 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 -- 172.21.15.100:0/1789922156 learned_addr learned my addr 172.21.15.100:0/1789922156 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73a9d9b640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73ac102570 0x7f73ac199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aad9d640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73ac102ef0 0x7f73ac1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 -- 172.21.15.100:0/1789922156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73ac102ef0 msgr2=0x7f73ac1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73ac102ef0 0x7f73ac1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 -- 172.21.15.100:0/1789922156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73ac102570 msgr2=0x7f73ac199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73ac102570 0x7f73ac199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 -- 172.21.15.100:0/1789922156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac1a4990 con 0x7f73ac100e20 2024-09-12T02:05:01.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73aa59c640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac100e20 0x7f73ac1993d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f739c00b4a0 tx=0x7f739c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73a37fe640 1 -- 172.21.15.100:0/1789922156 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c014070 con 0x7f73ac100e20 2024-09-12T02:05:01.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac1a4b60 con 0x7f73ac100e20 2024-09-12T02:05:01.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.439+0000 7f73a37fe640 1 -- 172.21.15.100:0/1789922156 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f739c010af0 con 0x7f73ac100e20 2024-09-12T02:05:01.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.440+0000 7f73a37fe640 1 -- 172.21.15.100:0/1789922156 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c01e060 con 0x7f73ac100e20 2024-09-12T02:05:01.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.440+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac1a5020 con 0x7f73ac100e20 2024-09-12T02:05:01.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.441+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac101200 con 0x7f73ac100e20 2024-09-12T02:05:01.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.442+0000 7f73a37fe640 1 -- 172.21.15.100:0/1789922156 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f739c017070 con 0x7f73ac100e20 2024-09-12T02:05:01.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.442+0000 7f73a37fe640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73980a2b80 0x7f73980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:01.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.443+0000 7f73a9d9b640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73980a2b80 0x7f73980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:01.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.443+0000 7f73a37fe640 1 -- 172.21.15.100:0/1789922156 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f739c0ce240 con 0x7f73ac100e20 2024-09-12T02:05:01.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.443+0000 7f73a9d9b640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73980a2b80 0x7f73980a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7394009230 tx=0x7f73940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:01.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.447+0000 7f73a37fe640 1 -- 172.21.15.100:0/1789922156 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f739c09aff0 con 0x7f73ac100e20 2024-09-12T02:05:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:01 smithi189 ceph-mon[35188]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:01 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.638+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f73ac109090 con 0x7f73ac100e20 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.639+0000 7f73a37fe640 1 -- 172.21.15.100:0/1789922156 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f739c09f2f0 con 0x7f73ac100e20 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:05:01.639 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73980a2b80 msgr2=0x7f73980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73980a2b80 0x7f73980a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7394009230 tx=0x7f73940058d0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac100e20 msgr2=0x7f73ac1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac100e20 0x7f73ac1993d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f739c00b4a0 tx=0x7f739c00b960 comp rx=0 tx=0).stop 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 shutdown_connections 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73980a2b80 0x7f73980a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73ac102ef0 0x7f73ac1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73ac102570 0x7f73ac199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 --2- 172.21.15.100:0/1789922156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ac100e20 0x7f73ac1993d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:01.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 >> 172.21.15.100:0/1789922156 conn(0x7f73ac0fc7d0 msgr2=0x7f73ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:01.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 shutdown_connections 2024-09-12T02:05:01.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:01.641+0000 7f73b0b9f640 1 -- 172.21.15.100:0/1789922156 wait complete. 2024-09-12T02:05:02.209 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:05:02.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:05:02.455 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:02.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:02.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:02.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1789922156' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:05:02.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:02 smithi100 ceph-mon[31179]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1789922156' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:02 smithi189 ceph-mon[35188]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1789922156' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:05:02.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:02 smithi117 ceph-mon[35240]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.900+0000 7f7bf3277640 1 -- 172.21.15.100:0/2408243540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec106a80 msgr2=0x7f7bec106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.900+0000 7f7bf3277640 1 --2- 172.21.15.100:0/2408243540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec106a80 0x7f7bec106e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009930 tx=0x7f7be802a420 comp rx=0 tx=0).stop 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.900+0000 7f7bf3277640 1 -- 172.21.15.100:0/2408243540 shutdown_connections 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.900+0000 7f7bf3277640 1 --2- 172.21.15.100:0/2408243540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bec101420 0x7f7bec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.900+0000 7f7bf3277640 1 --2- 172.21.15.100:0/2408243540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bec100a80 0x7f7bec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.900+0000 7f7bf3277640 1 --2- 172.21.15.100:0/2408243540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec106a80 0x7f7bec106e60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.900+0000 7f7bf3277640 1 -- 172.21.15.100:0/2408243540 >> 172.21.15.100:0/2408243540 conn(0x7f7bec0fc7a0 msgr2=0x7f7bec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 -- 172.21.15.100:0/2408243540 shutdown_connections 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 -- 172.21.15.100:0/2408243540 wait complete. 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 Processor -- start 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 -- start start 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bec100a80 0x7f7bec198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec101420 0x7f7bec1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bec106a80 0x7f7bec19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec110ec0 con 0x7f7bec101420 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec110d40 con 0x7f7bec106a80 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf3277640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec111040 con 0x7f7bec100a80 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf0812640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec101420 0x7f7bec1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf0812640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec101420 0x7f7bec1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58928/0 (socket says 172.21.15.100:58928) 2024-09-12T02:05:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.901+0000 7f7bf0812640 1 -- 172.21.15.100:0/3504108260 learned_addr learned my addr 172.21.15.100:0/3504108260 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf1013640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bec100a80 0x7f7bec198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf1814640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bec106a80 0x7f7bec19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf0812640 1 -- 172.21.15.100:0/3504108260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bec100a80 msgr2=0x7f7bec198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf0812640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bec100a80 0x7f7bec198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf0812640 1 -- 172.21.15.100:0/3504108260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bec106a80 msgr2=0x7f7bec19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf0812640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bec106a80 0x7f7bec19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf0812640 1 -- 172.21.15.100:0/3504108260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec19d430 con 0x7f7bec101420 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf1814640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bec106a80 0x7f7bec19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf0812640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec101420 0x7f7bec1989c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c970 tx=0x7f7bdc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7be27fc640 1 -- 172.21.15.100:0/3504108260 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc007bb0 con 0x7f7bec101420 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7be27fc640 1 -- 172.21.15.100:0/3504108260 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bdc007d50 con 0x7f7bec101420 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec19d720 con 0x7f7bec101420 2024-09-12T02:05:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7be27fc640 1 -- 172.21.15.100:0/3504108260 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00f450 con 0x7f7bec101420 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.902+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec1a5000 con 0x7f7bec101420 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.903+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec100ee0 con 0x7f7bec101420 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.904+0000 7f7be27fc640 1 -- 172.21.15.100:0/3504108260 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7bdc005020 con 0x7f7bec101420 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.905+0000 7f7be27fc640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7bd80a2b80 0x7f7bd80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.905+0000 7f7bf1013640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7bd80a2b80 0x7f7bd80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.905+0000 7f7be27fc640 1 -- 172.21.15.100:0/3504108260 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f7bdc0ce980 con 0x7f7bec101420 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.905+0000 7f7bf1013640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7bd80a2b80 0x7f7bd80a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009900 tx=0x7f7be80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:02.909+0000 7f7be27fc640 1 -- 172.21.15.100:0/3504108260 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bdc014030 con 0x7f7bec101420 2024-09-12T02:05:03.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:03.077+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7bec109a70 con 0x7f7bec101420 2024-09-12T02:05:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.012+0000 7f7be27fc640 1 -- 172.21.15.100:0/3504108260 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f7bdc09bd80 con 0x7f7bec101420 2024-09-12T02:05:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-09-12T02:05:04.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7bd80a2b80 msgr2=0x7f7bd80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:04.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7bd80a2b80 0x7f7bd80a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009900 tx=0x7f7be80058d0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec101420 msgr2=0x7f7bec1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec101420 0x7f7bec1989c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c970 tx=0x7f7bdc00ce30 comp rx=0 tx=0).stop 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 shutdown_connections 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7bd80a2b80 0x7f7bd80a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bec106a80 0x7f7bec19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bec101420 0x7f7bec1989c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 --2- 172.21.15.100:0/3504108260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bec100a80 0x7f7bec198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.015+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 >> 172.21.15.100:0/3504108260 conn(0x7f7bec0fc7a0 msgr2=0x7f7bec06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.016+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 shutdown_connections 2024-09-12T02:05:04.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:04.016+0000 7f7bf3277640 1 -- 172.21.15.100:0/3504108260 wait complete. 2024-09-12T02:05:04.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:04 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3504108260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:05:04.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:04 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3504108260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:05:04.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:04 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3504108260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:05:04.610 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:05:04.857 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:05.258 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:05 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3504108260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:05:05.258 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:05 smithi100 ceph-mon[31179]: pgmap v267: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:05.258 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:05 smithi100 ceph-mon[31179]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:05:05.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:05 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3504108260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:05:05.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:05 smithi189 ceph-mon[35188]: pgmap v267: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:05.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:05 smithi189 ceph-mon[35188]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:05:05.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 -- 172.21.15.100:0/1669723147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 msgr2=0x7f6ffc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:05.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 --2- 172.21.15.100:0/1669723147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc101200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009900 tx=0x7f6fec02a480 comp rx=0 tx=0).stop 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 -- 172.21.15.100:0/1669723147 shutdown_connections 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 --2- 172.21.15.100:0/1669723147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ffc102ef0 0x7f6ffc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 --2- 172.21.15.100:0/1669723147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc102570 0x7f6ffc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 --2- 172.21.15.100:0/1669723147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc101200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 -- 172.21.15.100:0/1669723147 >> 172.21.15.100:0/1669723147 conn(0x7f6ffc0fc7d0 msgr2=0x7f6ffc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 -- 172.21.15.100:0/1669723147 shutdown_connections 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.348+0000 7f7000e17640 1 -- 172.21.15.100:0/1669723147 wait complete. 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 Processor -- start 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 -- start start 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc102570 0x7f6ffc198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:05.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ffc102ef0 0x7f6ffc19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc111020 con 0x7f6ffc100e20 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc110ea0 con 0x7f6ffc102570 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f7000e17640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc1111a0 con 0x7f6ffc102ef0 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f6ffa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f6ffa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42144/0 (socket says 172.21.15.100:42144) 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f6ffa59c640 1 -- 172.21.15.100:0/2049191582 learned_addr learned my addr 172.21.15.100:0/2049191582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f6ff3fff640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc102570 0x7f6ffc198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.349+0000 7f6ffad9d640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ffc102ef0 0x7f6ffc19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ffa59c640 1 -- 172.21.15.100:0/2049191582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ffc102ef0 msgr2=0x7f6ffc19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:05.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ffa59c640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ffc102ef0 0x7f6ffc19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ffa59c640 1 -- 172.21.15.100:0/2049191582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc102570 msgr2=0x7f6ffc198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ffa59c640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc102570 0x7f6ffc198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ffa59c640 1 -- 172.21.15.100:0/2049191582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc19d600 con 0x7f6ffc100e20 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ffa59c640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc198650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fec006010 tx=0x7f6fec003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ff37fe640 1 -- 172.21.15.100:0/2049191582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec03f070 con 0x7f6ffc100e20 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ff37fe640 1 -- 172.21.15.100:0/2049191582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fec031e30 con 0x7f6ffc100e20 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc19d890 con 0x7f6ffc100e20 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f6ff37fe640 1 -- 172.21.15.100:0/2049191582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec035030 con 0x7f6ffc100e20 2024-09-12T02:05:05.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.350+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ffc1a51d0 con 0x7f6ffc100e20 2024-09-12T02:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.351+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ffc101280 con 0x7f6ffc100e20 2024-09-12T02:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.352+0000 7f6ff37fe640 1 -- 172.21.15.100:0/2049191582 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6fec042070 con 0x7f6ffc100e20 2024-09-12T02:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.353+0000 7f6ff37fe640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6fe80a2c00 0x7f6fe80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.353+0000 7f6ff3fff640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6fe80a2c00 0x7f6fe80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.353+0000 7f6ff37fe640 1 -- 172.21.15.100:0/2049191582 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f6fec0ef5a0 con 0x7f6ffc100e20 2024-09-12T02:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.354+0000 7f6ff3fff640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6fe80a2c00 0x7f6fe80a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0fef00 tx=0x7f6fe4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.358+0000 7f6ff37fe640 1 -- 172.21.15.100:0/2049191582 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fec0bc830 con 0x7f6ffc100e20 2024-09-12T02:05:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:05 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3504108260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:05:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:05 smithi117 ceph-mon[35240]: pgmap v267: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:05 smithi117 ceph-mon[35240]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:05:05.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:05.525+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6ffc1a53a0 con 0x7f6ffc100e20 2024-09-12T02:05:06.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.022+0000 7f6ff37fe640 1 -- 172.21.15.100:0/2049191582 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f6fec0bc130 con 0x7f6ffc100e20 2024-09-12T02:05:06.022 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6fe80a2c00 msgr2=0x7f6fe80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6fe80a2c00 0x7f6fe80a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0fef00 tx=0x7f6fe4009110 comp rx=0 tx=0).stop 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 msgr2=0x7f6ffc198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc198650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fec006010 tx=0x7f6fec003c80 comp rx=0 tx=0).stop 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 shutdown_connections 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6fe80a2c00 0x7f6fe80a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ffc102ef0 0x7f6ffc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ffc102570 0x7f6ffc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 --2- 172.21.15.100:0/2049191582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc100e20 0x7f6ffc198650 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.025+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 >> 172.21.15.100:0/2049191582 conn(0x7f6ffc0fc7d0 msgr2=0x7f6ffc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.026+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 shutdown_connections 2024-09-12T02:05:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:06.026+0000 7f7000e17640 1 -- 172.21.15.100:0/2049191582 wait complete. 2024-09-12T02:05:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:06 smithi100 ceph-mon[31179]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:05:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:06 smithi100 ceph-mon[31179]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:05:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:06 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2049191582' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:05:06.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:06 smithi189 ceph-mon[35188]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:05:06.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:06 smithi189 ceph-mon[35188]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:05:06.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:06 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2049191582' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:05:06.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:06 smithi117 ceph-mon[35240]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:05:06.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:06 smithi117 ceph-mon[35240]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:05:06.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:06 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2049191582' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:05:06.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:05:06.899 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:07 smithi100 ceph-mon[31179]: pgmap v269: 33 pgs: 1 creating+activating, 19 creating+peering, 10 unknown, 3 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:07 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2049191582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:05:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:07 smithi100 ceph-mon[31179]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:05:07.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:07 smithi189 ceph-mon[35188]: pgmap v269: 33 pgs: 1 creating+activating, 19 creating+peering, 10 unknown, 3 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:07.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:07 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2049191582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:05:07.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:07 smithi189 ceph-mon[35188]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:05:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.340+0000 7fe1d9bef640 1 -- 172.21.15.100:0/3588854850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4101400 msgr2=0x7fe1d410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.340+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/3588854850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4101400 0x7fe1d410d930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009cd0 tx=0x7fe1cc02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 -- 172.21.15.100:0/3588854850 shutdown_connections 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/3588854850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4101400 0x7fe1d410d930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/3588854850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1d4100a60 0x7fe1d4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/3588854850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4106a60 0x7fe1d4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 -- 172.21.15.100:0/3588854850 >> 172.21.15.100:0/3588854850 conn(0x7fe1d40fc780 msgr2=0x7fe1d40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 -- 172.21.15.100:0/3588854850 shutdown_connections 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 -- 172.21.15.100:0/3588854850 wait complete. 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 Processor -- start 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.341+0000 7fe1d9bef640 1 -- start start 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d9bef640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1d4100a60 0x7fe1d410e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d9bef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4101400 0x7fe1d410e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d9bef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4106a60 0x7fe1d410ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d9bef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4112000 con 0x7fe1d4106a60 2024-09-12T02:05:07.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d9bef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4111e80 con 0x7fe1d4101400 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d9bef640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4112180 con 0x7fe1d4100a60 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4106a60 0x7fe1d410ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4106a60 0x7fe1d410ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42168/0 (socket says 172.21.15.100:42168) 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 -- 172.21.15.100:0/4104652606 learned_addr learned my addr 172.21.15.100:0/4104652606 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d37fe640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1d4100a60 0x7fe1d410e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d2ffd640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4101400 0x7fe1d410e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 -- 172.21.15.100:0/4104652606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1d4100a60 msgr2=0x7fe1d410e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1d4100a60 0x7fe1d410e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 -- 172.21.15.100:0/4104652606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4101400 msgr2=0x7fe1d410e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4101400 0x7fe1d410e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 -- 172.21.15.100:0/4104652606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d41a6a90 con 0x7fe1d4106a60 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d2ffd640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4101400 0x7fe1d410e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:07.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d3fff640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4106a60 0x7fe1d410ee40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006010 tx=0x7fe1cc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d0ff9640 1 -- 172.21.15.100:0/4104652606 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc004450 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d0ff9640 1 -- 172.21.15.100:0/4104652606 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1cc003e10 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.342+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d41a6d20 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.343+0000 7fe1d0ff9640 1 -- 172.21.15.100:0/4104652606 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc046480 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.343+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d41a7260 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.343+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d4100f40 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.345+0000 7fe1d0ff9640 1 -- 172.21.15.100:0/4104652606 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe1cc0045f0 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.346+0000 7fe1d0ff9640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe1c00a2b80 0x7fe1c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.346+0000 7fe1d37fe640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe1c00a2b80 0x7fe1c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.346+0000 7fe1d0ff9640 1 -- 172.21.15.100:0/4104652606 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7fe1cc02e030 con 0x7fe1d4106a60 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.346+0000 7fe1d37fe640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe1c00a2b80 0x7fe1c00a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009990 tx=0x7fe1bc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:07.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.349+0000 7fe1d0ff9640 1 -- 172.21.15.100:0/4104652606 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1cc04b060 con 0x7fe1d4106a60 2024-09-12T02:05:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:07 smithi117 ceph-mon[35240]: pgmap v269: 33 pgs: 1 creating+activating, 19 creating+peering, 10 unknown, 3 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:07 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2049191582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:05:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:07 smithi117 ceph-mon[35240]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:05:07.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:07.549+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe1d4108a60 con 0x7fe1d4106a60 2024-09-12T02:05:08.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.040+0000 7fe1d0ff9640 1 -- 172.21.15.100:0/4104652606 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fe1cc0bdaa0 con 0x7fe1d4106a60 2024-09-12T02:05:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe1c00a2b80 msgr2=0x7fe1c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe1c00a2b80 0x7fe1c00a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009990 tx=0x7fe1bc009110 comp rx=0 tx=0).stop 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4106a60 msgr2=0x7fe1d410ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4106a60 0x7fe1d410ee40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006010 tx=0x7fe1cc003c20 comp rx=0 tx=0).stop 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 shutdown_connections 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe1c00a2b80 0x7fe1c00a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1d4106a60 0x7fe1d410ee40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4101400 0x7fe1d410e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 --2- 172.21.15.100:0/4104652606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1d4100a60 0x7fe1d410e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.043+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 >> 172.21.15.100:0/4104652606 conn(0x7fe1d40fc780 msgr2=0x7fe1d40fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.044+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 shutdown_connections 2024-09-12T02:05:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:08.044+0000 7fe1d9bef640 1 -- 172.21.15.100:0/4104652606 wait complete. 2024-09-12T02:05:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:08 smithi100 ceph-mon[31179]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:05:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:08 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4104652606' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:05:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:08 smithi100 ceph-mon[31179]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:05:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:08 smithi189 ceph-mon[35188]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:05:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:08 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/4104652606' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:05:08.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:08 smithi189 ceph-mon[35188]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:05:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:08 smithi117 ceph-mon[35240]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:05:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:08 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/4104652606' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:05:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:08 smithi117 ceph-mon[35240]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:05:08.663 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:05:08.909 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:09 smithi100 ceph-mon[31179]: pgmap v272: 97 pgs: 1 creating+activating, 35 creating+peering, 54 unknown, 7 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:09 smithi100 ceph-mon[31179]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:05:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:09 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4104652606' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:05:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:09 smithi100 ceph-mon[31179]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:05:09.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:09 smithi100 ceph-mon[31179]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:05:09.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 -- 172.21.15.100:0/503207023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b601036b0 msgr2=0x7f3b6010bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 --2- 172.21.15.100:0/503207023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b601036b0 0x7f3b6010bba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009900 tx=0x7f3b5402a480 comp rx=0 tx=0).stop 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 -- 172.21.15.100:0/503207023 shutdown_connections 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 --2- 172.21.15.100:0/503207023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b6010c170 0x7f3b6010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 --2- 172.21.15.100:0/503207023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b601036b0 0x7f3b6010bba0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 --2- 172.21.15.100:0/503207023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b60102d90 0x7f3b60103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 -- 172.21.15.100:0/503207023 >> 172.21.15.100:0/503207023 conn(0x7f3b600fc790 msgr2=0x7f3b600febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 -- 172.21.15.100:0/503207023 shutdown_connections 2024-09-12T02:05:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 -- 172.21.15.100:0/503207023 wait complete. 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 Processor -- start 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.328+0000 7f3b655e2640 1 -- start start 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b655e2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b60102d90 0x7f3b60198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b655e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b601036b0 0x7f3b60198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b655e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b6010c170 0x7f3b6019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b655e2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60111f50 con 0x7f3b6010c170 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b655e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60111dd0 con 0x7f3b601036b0 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b655e2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b601120d0 con 0x7f3b60102d90 2024-09-12T02:05:09.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b6010c170 0x7f3b6019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b6010c170 0x7f3b6019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42186/0 (socket says 172.21.15.100:42186) 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 -- 172.21.15.100:0/978138525 learned_addr learned my addr 172.21.15.100:0/978138525 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5effd640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b60102d90 0x7f3b60198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5e7fc640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b601036b0 0x7f3b60198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 -- 172.21.15.100:0/978138525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b60102d90 msgr2=0x7f3b60198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b60102d90 0x7f3b60198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 -- 172.21.15.100:0/978138525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b601036b0 msgr2=0x7f3b60198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b601036b0 0x7f3b60198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 -- 172.21.15.100:0/978138525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6019d400 con 0x7f3b6010c170 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5e7fc640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b601036b0 0x7f3b60198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b5f7fe640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b6010c170 0x7f3b6019cd20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800eaa0 tx=0x7f3b5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b47fff640 1 -- 172.21.15.100:0/978138525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800cdb0 con 0x7f3b6010c170 2024-09-12T02:05:09.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b47fff640 1 -- 172.21.15.100:0/978138525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b58005020 con 0x7f3b6010c170 2024-09-12T02:05:09.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.329+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6019d6f0 con 0x7f3b6010c170 2024-09-12T02:05:09.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.330+0000 7f3b47fff640 1 -- 172.21.15.100:0/978138525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b580116b0 con 0x7f3b6010c170 2024-09-12T02:05:09.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.330+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b601a4fd0 con 0x7f3b6010c170 2024-09-12T02:05:09.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.331+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b60103170 con 0x7f3b6010c170 2024-09-12T02:05:09.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.332+0000 7f3b47fff640 1 -- 172.21.15.100:0/978138525 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3b58005560 con 0x7f3b6010c170 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.333+0000 7f3b47fff640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3b480a2c00 0x7f3b480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.333+0000 7f3b5effd640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3b480a2c00 0x7f3b480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.333+0000 7f3b47fff640 1 -- 172.21.15.100:0/978138525 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3b580cf430 con 0x7f3b6010c170 2024-09-12T02:05:09.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.334+0000 7f3b5effd640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3b480a2c00 0x7f3b480a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b50005fd0 tx=0x7f3b5000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:09.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.336+0000 7f3b47fff640 1 -- 172.21.15.100:0/978138525 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b58016030 con 0x7f3b6010c170 2024-09-12T02:05:09.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:09 smithi189 ceph-mon[35188]: pgmap v272: 97 pgs: 1 creating+activating, 35 creating+peering, 54 unknown, 7 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:09.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:09 smithi189 ceph-mon[35188]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:05:09.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:09 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/4104652606' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:05:09.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:09 smithi189 ceph-mon[35188]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:05:09.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:09 smithi189 ceph-mon[35188]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:05:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:09 smithi117 ceph-mon[35240]: pgmap v272: 97 pgs: 1 creating+activating, 35 creating+peering, 54 unknown, 7 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:05:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:09 smithi117 ceph-mon[35240]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:05:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:09 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/4104652606' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:05:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:09 smithi117 ceph-mon[35240]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:05:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:09 smithi117 ceph-mon[35240]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:05:09.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.506+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b60106c20 con 0x7f3b6010c170 2024-09-12T02:05:09.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.508+0000 7f3b47fff640 1 -- 172.21.15.100:0/978138525 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22361 (secure 0 0 0) 0x7f3b5809c560 con 0x7f3b6010c170 2024-09-12T02:05:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:09.508 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":80,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:07.550311+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3b480a2c00 msgr2=0x7f3b480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3b480a2c00 0x7f3b480a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b50005fd0 tx=0x7f3b5000b390 comp rx=0 tx=0).stop 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b6010c170 msgr2=0x7f3b6019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b6010c170 0x7f3b6019cd20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800eaa0 tx=0x7f3b5800ef60 comp rx=0 tx=0).stop 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 shutdown_connections 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3b480a2c00 0x7f3b480a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b6010c170 0x7f3b6019cd20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b601036b0 0x7f3b60198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 --2- 172.21.15.100:0/978138525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b60102d90 0x7f3b60198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:09.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 >> 172.21.15.100:0/978138525 conn(0x7f3b600fc790 msgr2=0x7f3b600fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:09.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 shutdown_connections 2024-09-12T02:05:09.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:09.510+0000 7f3b655e2640 1 -- 172.21.15.100:0/978138525 wait complete. 2024-09-12T02:05:10.136 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:10 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] up:active 2024-09-12T02:05:10.136 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:10 smithi100 ceph-mon[31179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:10.136 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:10 smithi100 ceph-mon[31179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:10.136 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:10 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/978138525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:10.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:05:10.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:10 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] up:active 2024-09-12T02:05:10.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:10 smithi189 ceph-mon[35188]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:10.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:10 smithi189 ceph-mon[35188]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:10.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:10 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/978138525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:10 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] up:active 2024-09-12T02:05:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:10 smithi117 ceph-mon[35240]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:10 smithi117 ceph-mon[35240]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:10 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/978138525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:10.426 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:10.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 -- 172.21.15.100:0/3485056141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8102ef0 msgr2=0x7f45a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 --2- 172.21.15.100:0/3485056141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8102ef0 0x7f45a810da40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009ca0 tx=0x7f45a002a950 comp rx=0 tx=0).stop 2024-09-12T02:05:10.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 -- 172.21.15.100:0/3485056141 shutdown_connections 2024-09-12T02:05:10.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 --2- 172.21.15.100:0/3485056141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8102ef0 0x7f45a810da40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 --2- 172.21.15.100:0/3485056141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8102570 0x7f45a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 --2- 172.21.15.100:0/3485056141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a8100e20 0x7f45a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 -- 172.21.15.100:0/3485056141 >> 172.21.15.100:0/3485056141 conn(0x7f45a80fc7d0 msgr2=0x7f45a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 -- 172.21.15.100:0/3485056141 shutdown_connections 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.827+0000 7f45ae00b640 1 -- 172.21.15.100:0/3485056141 wait complete. 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 Processor -- start 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 -- start start 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8100e20 0x7f45a8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a8102570 0x7f45a81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8102ef0 0x7f45a81a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8110f80 con 0x7f45a8100e20 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8110e00 con 0x7f45a8102ef0 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45ae00b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8111100 con 0x7f45a8102570 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45a77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8100e20 0x7f45a8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45a77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8100e20 0x7f45a8199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42210/0 (socket says 172.21.15.100:42210) 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f45a77fe640 1 -- 172.21.15.100:0/45673081 learned_addr learned my addr 172.21.15.100:0/45673081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.828+0000 7f459ffff640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a8102570 0x7f45a81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a77fe640 1 -- 172.21.15.100:0/45673081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a8102570 msgr2=0x7f45a81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a7fff640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8102ef0 0x7f45a81a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a77fe640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a8102570 0x7f45a81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a77fe640 1 -- 172.21.15.100:0/45673081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8102ef0 msgr2=0x7f45a81a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a77fe640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8102ef0 0x7f45a81a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a77fe640 1 -- 172.21.15.100:0/45673081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a81a4950 con 0x7f45a8100e20 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f459ffff640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a8102570 0x7f45a81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a77fe640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8100e20 0x7f45a8199390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f459800c970 tx=0x7f459800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a57fa640 1 -- 172.21.15.100:0/45673081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598007bb0 con 0x7f45a8100e20 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a81a4b20 con 0x7f45a8100e20 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a57fa640 1 -- 172.21.15.100:0/45673081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4598007d50 con 0x7f45a8100e20 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45a57fa640 1 -- 172.21.15.100:0/45673081 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459800f450 con 0x7f45a8100e20 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.829+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a81a5000 con 0x7f45a8100e20 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.830+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a8101200 con 0x7f45a8100e20 2024-09-12T02:05:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.831+0000 7f45a57fa640 1 -- 172.21.15.100:0/45673081 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4598005020 con 0x7f45a8100e20 2024-09-12T02:05:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.832+0000 7f45a57fa640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45940a2b80 0x7f45940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.832+0000 7f459ffff640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45940a2b80 0x7f45940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.832+0000 7f45a57fa640 1 -- 172.21.15.100:0/45673081 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f45980ced30 con 0x7f45a8100e20 2024-09-12T02:05:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.832+0000 7f459ffff640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45940a2b80 0x7f45940a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4590005fd0 tx=0x7f4590005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:10.836+0000 7f45a57fa640 1 -- 172.21.15.100:0/45673081 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4598014030 con 0x7f45a8100e20 2024-09-12T02:05:11.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.007+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45a8109090 con 0x7f45a8100e20 2024-09-12T02:05:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.008+0000 7f45a57fa640 1 -- 172.21.15.100:0/45673081 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22361 (secure 0 0 0) 0x7f459809bde0 con 0x7f45a8100e20 2024-09-12T02:05:11.009 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:11.009 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":80,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:07.550311+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45940a2b80 msgr2=0x7f45940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45940a2b80 0x7f45940a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4590005fd0 tx=0x7f4590005850 comp rx=0 tx=0).stop 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8100e20 msgr2=0x7f45a8199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8100e20 0x7f45a8199390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f459800c970 tx=0x7f459800ce30 comp rx=0 tx=0).stop 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 shutdown_connections 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45940a2b80 0x7f45940a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8102ef0 0x7f45a81a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a8102570 0x7f45a81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 --2- 172.21.15.100:0/45673081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45a8100e20 0x7f45a8199390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 >> 172.21.15.100:0/45673081 conn(0x7f45a80fc7d0 msgr2=0x7f45a81068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 shutdown_connections 2024-09-12T02:05:11.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:11.011+0000 7f45ae00b640 1 -- 172.21.15.100:0/45673081 wait complete. 2024-09-12T02:05:11.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:11 smithi100 ceph-mon[31179]: pgmap v274: 97 pgs: 1 creating+activating, 16 creating+peering, 2 unknown, 78 active+clean; 578 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-12T02:05:11.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:11 smithi100 ceph-mon[31179]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:05:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:11 smithi100 ceph-mon[31179]: Cluster is now healthy 2024-09-12T02:05:11.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:11 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/45673081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:11 smithi189 ceph-mon[35188]: pgmap v274: 97 pgs: 1 creating+activating, 16 creating+peering, 2 unknown, 78 active+clean; 578 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-12T02:05:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:11 smithi189 ceph-mon[35188]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:05:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:11 smithi189 ceph-mon[35188]: Cluster is now healthy 2024-09-12T02:05:11.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:11 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/45673081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:11 smithi117 ceph-mon[35240]: pgmap v274: 97 pgs: 1 creating+activating, 16 creating+peering, 2 unknown, 78 active+clean; 578 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-12T02:05:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:11 smithi117 ceph-mon[35240]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:05:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:11 smithi117 ceph-mon[35240]: Cluster is now healthy 2024-09-12T02:05:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:11 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/45673081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:11.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:05:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:12.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.338+0000 7f780ab6f640 1 -- 172.21.15.100:0/2350817387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 msgr2=0x7f7804101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.338+0000 7f780ab6f640 1 --2- 172.21.15.100:0/2350817387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804101200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009900 tx=0x7f77f802a480 comp rx=0 tx=0).stop 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 -- 172.21.15.100:0/2350817387 shutdown_connections 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 --2- 172.21.15.100:0/2350817387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7804102ef0 0x7f780410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 --2- 172.21.15.100:0/2350817387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7804102570 0x7f78041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 --2- 172.21.15.100:0/2350817387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804101200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 -- 172.21.15.100:0/2350817387 >> 172.21.15.100:0/2350817387 conn(0x7f78040fc7d0 msgr2=0x7f78040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 -- 172.21.15.100:0/2350817387 shutdown_connections 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 -- 172.21.15.100:0/2350817387 wait complete. 2024-09-12T02:05:12.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 Processor -- start 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.339+0000 7f780ab6f640 1 -- start start 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780ab6f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780ab6f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7804102570 0x7f7804199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780ab6f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7804102ef0 0x7f78041a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780ab6f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7804110f80 con 0x7f7804100e20 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780ab6f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7804110e00 con 0x7f7804102ef0 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780ab6f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7804111100 con 0x7f7804102570 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42228/0 (socket says 172.21.15.100:42228) 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 -- 172.21.15.100:0/1223567248 learned_addr learned my addr 172.21.15.100:0/1223567248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f7803fff640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7804102570 0x7f7804199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780910c640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7804102ef0 0x7f78041a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 -- 172.21.15.100:0/1223567248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7804102570 msgr2=0x7f7804199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7804102570 0x7f7804199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 -- 172.21.15.100:0/1223567248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7804102ef0 msgr2=0x7f78041a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7804102ef0 0x7f78041a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 -- 172.21.15.100:0/1223567248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78041a48d0 con 0x7f7804100e20 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780890b640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804199310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77f8006010 tx=0x7f77f8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f7801ffb640 1 -- 172.21.15.100:0/1223567248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f803f070 con 0x7f7804100e20 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f7801ffb640 1 -- 172.21.15.100:0/1223567248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f8031e30 con 0x7f7804100e20 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f7801ffb640 1 -- 172.21.15.100:0/1223567248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8035030 con 0x7f7804100e20 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.340+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78041a4aa0 con 0x7f7804100e20 2024-09-12T02:05:12.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.341+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78041a4f50 con 0x7f7804100e20 2024-09-12T02:05:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.342+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7804101200 con 0x7f7804100e20 2024-09-12T02:05:12.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.343+0000 7f7801ffb640 1 -- 172.21.15.100:0/1223567248 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f77f8042070 con 0x7f7804100e20 2024-09-12T02:05:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.343+0000 7f7801ffb640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77f40a2b80 0x7f77f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.343+0000 7f7803fff640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77f40a2b80 0x7f77f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.343+0000 7f7801ffb640 1 -- 172.21.15.100:0/1223567248 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f77f80ef830 con 0x7f7804100e20 2024-09-12T02:05:12.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.344+0000 7f7803fff640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77f40a2b80 0x7f77f40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f780406ab00 tx=0x7f77f000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:12.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.348+0000 7f7801ffb640 1 -- 172.21.15.100:0/1223567248 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77f80bc1f0 con 0x7f7804100e20 2024-09-12T02:05:12.400 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:05:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: 2024-09-12T02:05:12.099+0000 7f168a835640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:05:12.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:12.548+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7804109090 con 0x7f7804100e20 2024-09-12T02:05:13.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.051+0000 7f7801ffb640 1 -- 172.21.15.100:0/1223567248 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f77f80c04f0 con 0x7f7804100e20 2024-09-12T02:05:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77f40a2b80 msgr2=0x7f77f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77f40a2b80 0x7f77f40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f780406ab00 tx=0x7f77f000a2d0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 msgr2=0x7f7804199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804199310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77f8006010 tx=0x7f77f8003c80 comp rx=0 tx=0).stop 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 shutdown_connections 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77f40a2b80 0x7f77f40a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7804102ef0 0x7f78041a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7804102570 0x7f7804199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 --2- 172.21.15.100:0/1223567248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7804100e20 0x7f7804199310 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 >> 172.21.15.100:0/1223567248 conn(0x7f78040fc7d0 msgr2=0x7f78040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 shutdown_connections 2024-09-12T02:05:13.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:13.053+0000 7f780ab6f640 1 -- 172.21.15.100:0/1223567248 wait complete. 2024-09-12T02:05:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:13 smithi100 ceph-mon[31179]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:05:13.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:13 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1223567248' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:05:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:13 smithi189 ceph-mon[35188]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:05:13.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:13 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1223567248' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:05:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:13 smithi117 ceph-mon[35240]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:05:13.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:13 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1223567248' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:05:13.700 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-12T02:05:13.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-12T02:05:13.947 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:14.308 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:14 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1223567248' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:05:14.308 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:14 smithi100 ceph-mon[31179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:14 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1223567248' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:05:14.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:14 smithi189 ceph-mon[35188]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:14.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:14 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1223567248' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:05:14.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:14 smithi117 ceph-mon[35240]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 -- 172.21.15.100:0/114497793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 msgr2=0x7fc6941021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/114497793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc6941021d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc690009900 tx=0x7fc69002a410 comp rx=0 tx=0).stop 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 -- 172.21.15.100:0/114497793 shutdown_connections 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/114497793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc694106f20 0x7fc69410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/114497793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6941027a0 0x7fc6941067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/114497793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc6941021d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 -- 172.21.15.100:0/114497793 >> 172.21.15.100:0/114497793 conn(0x7fc6940fd8b0 msgr2=0x7fc6940ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 -- 172.21.15.100:0/114497793 shutdown_connections 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.387+0000 7fc69c7e3640 1 -- 172.21.15.100:0/114497793 wait complete. 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 Processor -- start 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 -- start start 2024-09-12T02:05:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc694198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6941027a0 0x7fc694198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc694106f20 0x7fc69419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc694112020 con 0x7fc694101df0 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc694111ea0 con 0x7fc694106f20 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69c7e3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6941121a0 con 0x7fc6941027a0 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc694198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc694198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42274/0 (socket says 172.21.15.100:42274) 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 -- 172.21.15.100:0/3867330150 learned_addr learned my addr 172.21.15.100:0/3867330150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc699d7e640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6941027a0 0x7fc694198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69ad80640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc694106f20 0x7fc69419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 -- 172.21.15.100:0/3867330150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6941027a0 msgr2=0x7fc694198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6941027a0 0x7fc694198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 -- 172.21.15.100:0/3867330150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc694106f20 msgr2=0x7fc69419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc694106f20 0x7fc69419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69a57f640 1 -- 172.21.15.100:0/3867330150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69419d5f0 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.388+0000 7fc69ad80640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc694106f20 0x7fc69419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.389+0000 7fc69a57f640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc694198640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc690005ab0 tx=0x7fc6900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.389+0000 7fc68b7fe640 1 -- 172.21.15.100:0/3867330150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69003f030 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.389+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69419d880 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.389+0000 7fc68b7fe640 1 -- 172.21.15.100:0/3867330150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc690003ce0 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.389+0000 7fc68b7fe640 1 -- 172.21.15.100:0/3867330150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035070 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.389+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6941a51c0 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.390+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6941032d0 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.392+0000 7fc68b7fe640 1 -- 172.21.15.100:0/3867330150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc690042030 con 0x7fc694101df0 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.392+0000 7fc68b7fe640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc6800a2b80 0x7fc6800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.392+0000 7fc699d7e640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc6800a2b80 0x7fc6800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.392+0000 7fc68b7fe640 1 -- 172.21.15.100:0/3867330150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc6900efae0 con 0x7fc694101df0 2024-09-12T02:05:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.393+0000 7fc699d7e640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc6800a2b80 0x7fc6800a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc6940ffec0 tx=0x7fc684008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.395+0000 7fc68b7fe640 1 -- 172.21.15.100:0/3867330150 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6900bcb90 con 0x7fc694101df0 2024-09-12T02:05:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:14.598+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fc69410a100 con 0x7fc694101df0 2024-09-12T02:05:15.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.068+0000 7fc68b7fe640 1 -- 172.21.15.100:0/3867330150 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fc6900bc490 con 0x7fc694101df0 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc6800a2b80 msgr2=0x7fc6800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc6800a2b80 0x7fc6800a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc6940ffec0 tx=0x7fc684008040 comp rx=0 tx=0).stop 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 msgr2=0x7fc694198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc694198640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc690005ab0 tx=0x7fc6900042f0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 shutdown_connections 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc6800a2b80 0x7fc6800a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc694106f20 0x7fc69419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6941027a0 0x7fc694198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 --2- 172.21.15.100:0/3867330150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc694101df0 0x7fc694198640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 >> 172.21.15.100:0/3867330150 conn(0x7fc6940fd8b0 msgr2=0x7fc6940fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:15.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 shutdown_connections 2024-09-12T02:05:15.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:15.071+0000 7fc69c7e3640 1 -- 172.21.15.100:0/3867330150 wait complete. 2024-09-12T02:05:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:15 smithi100 ceph-mon[31179]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T02:05:15.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:15 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3867330150' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:05:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:15 smithi189 ceph-mon[35188]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T02:05:15.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:15 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3867330150' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:05:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:15 smithi117 ceph-mon[35240]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T02:05:15.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:15 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3867330150' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:05:15.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T02:05:15.950 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:16.314 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:16 smithi100 ceph-mon[31179]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:05:16.314 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:16 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3867330150' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:05:16.314 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:16 smithi100 ceph-mon[31179]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:05:16.315 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:16 smithi100 ceph-mon[31179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:16.315 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:16 smithi100 ceph-mon[31179]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:05:16.315 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:16 smithi100 ceph-mon[31179]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:05:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:16 smithi189 ceph-mon[35188]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:05:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:16 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3867330150' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:05:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:16 smithi189 ceph-mon[35188]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:05:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:16 smithi189 ceph-mon[35188]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:16 smithi189 ceph-mon[35188]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:05:16.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:16 smithi189 ceph-mon[35188]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:05:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:16 smithi117 ceph-mon[35240]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:05:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:16 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3867330150' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:05:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:16 smithi117 ceph-mon[35240]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:05:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:16 smithi117 ceph-mon[35240]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:05:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:16 smithi117 ceph-mon[35240]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:05:16.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:16 smithi117 ceph-mon[35240]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:05:16.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.399+0000 7f755da8b640 1 -- 172.21.15.100:0/3968558135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75581036e0 msgr2=0x7f7558107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.399+0000 7f755da8b640 1 --2- 172.21.15.100:0/3968558135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75581036e0 0x7f7558107b90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f754c009930 tx=0x7f754c02a420 comp rx=0 tx=0).stop 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 -- 172.21.15.100:0/3968558135 shutdown_connections 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 --2- 172.21.15.100:0/3968558135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75581082a0 0x7f755810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 --2- 172.21.15.100:0/3968558135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75581036e0 0x7f7558107b90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 --2- 172.21.15.100:0/3968558135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7558102d30 0x7f7558103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 -- 172.21.15.100:0/3968558135 >> 172.21.15.100:0/3968558135 conn(0x7f75580fc7d0 msgr2=0x7f75580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 -- 172.21.15.100:0/3968558135 shutdown_connections 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 -- 172.21.15.100:0/3968558135 wait complete. 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 Processor -- start 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 -- start start 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558102d30 0x7f7558198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75581036e0 0x7f7558198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.400+0000 7f755da8b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75581082a0 0x7f755819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f755da8b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75581120a0 con 0x7f7558102d30 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f755da8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7558111f20 con 0x7f75581036e0 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f755da8b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7558112220 con 0x7f75581082a0 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558102d30 0x7f7558198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558102d30 0x7f7558198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42298/0 (socket says 172.21.15.100:42298) 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 -- 172.21.15.100:0/480980261 learned_addr learned my addr 172.21.15.100:0/480980261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f7557fff640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75581082a0 0x7f755819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f7556ffd640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75581036e0 0x7f7558198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 -- 172.21.15.100:0/480980261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75581082a0 msgr2=0x7f755819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75581082a0 0x7f755819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 -- 172.21.15.100:0/480980261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75581036e0 msgr2=0x7f7558198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75581036e0 0x7f7558198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 -- 172.21.15.100:0/480980261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755819d5f0 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f7556ffd640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75581036e0 0x7f7558198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f75577fe640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558102d30 0x7f7558198640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f754800c890 tx=0x7f754800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f7554ff9640 1 -- 172.21.15.100:0/480980261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548004220 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755819d8e0 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f7554ff9640 1 -- 172.21.15.100:0/480980261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75480043c0 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f7554ff9640 1 -- 172.21.15.100:0/480980261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548004a00 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.401+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75581a51c0 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.402+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7558103110 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.403+0000 7f7554ff9640 1 -- 172.21.15.100:0/480980261 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f75480079b0 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.404+0000 7f7554ff9640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f75400a2b80 0x7f75400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.404+0000 7f7556ffd640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f75400a2b80 0x7f75400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.405+0000 7f7554ff9640 1 -- 172.21.15.100:0/480980261 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f75480ceff0 con 0x7f7558102d30 2024-09-12T02:05:16.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.405+0000 7f7556ffd640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f75400a2b80 0x7f75400a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f754c009900 tx=0x7f754c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.408+0000 7f7554ff9640 1 -- 172.21.15.100:0/480980261 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7548014030 con 0x7f7558102d30 2024-09-12T02:05:16.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.608+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f755810a2b0 con 0x7f7558102d30 2024-09-12T02:05:16.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.751+0000 7f7554ff9640 1 -- 172.21.15.100:0/480980261 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f754809c0a0 con 0x7f7558102d30 2024-09-12T02:05:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f75400a2b80 msgr2=0x7f75400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f75400a2b80 0x7f75400a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f754c009900 tx=0x7f754c005a20 comp rx=0 tx=0).stop 2024-09-12T02:05:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558102d30 msgr2=0x7f7558198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558102d30 0x7f7558198640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f754800c890 tx=0x7f754800cd50 comp rx=0 tx=0).stop 2024-09-12T02:05:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 shutdown_connections 2024-09-12T02:05:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f75400a2b80 0x7f75400a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75581082a0 0x7f755819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75581036e0 0x7f7558198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 --2- 172.21.15.100:0/480980261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558102d30 0x7f7558198640 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 >> 172.21.15.100:0/480980261 conn(0x7f75580fc7d0 msgr2=0x7f7558106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 shutdown_connections 2024-09-12T02:05:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:16.753+0000 7f755da8b640 1 -- 172.21.15.100:0/480980261 wait complete. 2024-09-12T02:05:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:05:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] up:active 2024-09-12T02:05:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:05:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:05:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: Cluster is now healthy 2024-09-12T02:05:17.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:05:17.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T02:05:17.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T02:05:17.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/480980261' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:05:17.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/480980261' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:05:17.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] up:active 2024-09-12T02:05:17.344 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:17 smithi189 ceph-mon[35188]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:05:17.400 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: 2024-09-12T02:05:17.099+0000 7f168a835640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T02:05:17.400 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: 2024-09-12T02:05:17.099+0000 7f168a835640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T02:05:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:05:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] up:active 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: Cluster is now healthy 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/480980261' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/480980261' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] up:active 2024-09-12T02:05:17.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:17 smithi117 ceph-mon[35240]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:05:17.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:05:17.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] up:active 2024-09-12T02:05:17.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:05:17.418 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: Cluster is now healthy 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/480980261' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/480980261' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] up:active 2024-09-12T02:05:17.419 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:17 smithi100 ceph-mon[31179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:05:17.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T02:05:17.695 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:18.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 -- 172.21.15.100:0/1239337272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954101de0 msgr2=0x7f69541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 --2- 172.21.15.100:0/1239337272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954101de0 0x7f69541021c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6944009900 tx=0x7f694402a410 comp rx=0 tx=0).stop 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 -- 172.21.15.100:0/1239337272 shutdown_connections 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 --2- 172.21.15.100:0/1239337272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6954106f10 0x7f695410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 --2- 172.21.15.100:0/1239337272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6954102790 0x7f69541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 --2- 172.21.15.100:0/1239337272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954101de0 0x7f69541021c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 -- 172.21.15.100:0/1239337272 >> 172.21.15.100:0/1239337272 conn(0x7f69540fd8c0 msgr2=0x7f69540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 -- 172.21.15.100:0/1239337272 shutdown_connections 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.137+0000 7f6958a9b640 1 -- 172.21.15.100:0/1239337272 wait complete. 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 Processor -- start 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 -- start start 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6954101de0 0x7f69541985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954102790 0x7f6954198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6954106f10 0x7f695419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6954112010 con 0x7f6954102790 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6954111e90 con 0x7f6954106f10 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f6958a9b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6954112190 con 0x7f6954101de0 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f694bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954102790 0x7f6954198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f694bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954102790 0x7f6954198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42320/0 (socket says 172.21.15.100:42320) 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f694bfff640 1 -- 172.21.15.100:0/2543139471 learned_addr learned my addr 172.21.15.100:0/2543139471 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.138+0000 7f695259c640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6954101de0 0x7f69541985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f6952d9d640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6954106f10 0x7f695419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694bfff640 1 -- 172.21.15.100:0/2543139471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6954101de0 msgr2=0x7f69541985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694bfff640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6954101de0 0x7f69541985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694bfff640 1 -- 172.21.15.100:0/2543139471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6954106f10 msgr2=0x7f695419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:18.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694bfff640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6954106f10 0x7f695419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694bfff640 1 -- 172.21.15.100:0/2543139471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695419d560 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f695259c640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6954101de0 0x7f69541985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694bfff640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954102790 0x7f6954198af0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f693c00b4a0 tx=0x7f693c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694b7fe640 1 -- 172.21.15.100:0/2543139471 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c014070 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694b7fe640 1 -- 172.21.15.100:0/2543139471 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f693c010af0 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695419d850 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f694b7fe640 1 -- 172.21.15.100:0/2543139471 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c017d10 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.139+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69541a5130 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.140+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6954102240 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.141+0000 7f694b7fe640 1 -- 172.21.15.100:0/2543139471 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f693c017070 con 0x7f6954102790 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.142+0000 7f694b7fe640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f69400a2b80 0x7f69400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.142+0000 7f695259c640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f69400a2b80 0x7f69400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:18.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.142+0000 7f694b7fe640 1 -- 172.21.15.100:0/2543139471 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f693c0ce780 con 0x7f6954102790 2024-09-12T02:05:18.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.142+0000 7f695259c640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f69400a2b80 0x7f69400a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6944005ab0 tx=0x7f6944005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:18.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.145+0000 7f694b7fe640 1 -- 172.21.15.100:0/2543139471 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f693c09b830 con 0x7f6954102790 2024-09-12T02:05:18.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:18.349+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f6954199910 con 0x7f6954102790 2024-09-12T02:05:19.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.083+0000 7f694b7fe640 1 -- 172.21.15.100:0/2543139471 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f6954199910 con 0x7f6954102790 2024-09-12T02:05:19.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f69400a2b80 msgr2=0x7f69400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:19.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f69400a2b80 0x7f69400a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6944005ab0 tx=0x7f6944005a20 comp rx=0 tx=0).stop 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954102790 msgr2=0x7f6954198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954102790 0x7f6954198af0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f693c00b4a0 tx=0x7f693c00b960 comp rx=0 tx=0).stop 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 shutdown_connections 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f69400a2b80 0x7f69400a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6954106f10 0x7f695419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6954102790 0x7f6954198af0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 --2- 172.21.15.100:0/2543139471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6954101de0 0x7f69541985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.086+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 >> 172.21.15.100:0/2543139471 conn(0x7f69540fd8c0 msgr2=0x7f69540fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.087+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 shutdown_connections 2024-09-12T02:05:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:19.087+0000 7f6958a9b640 1 -- 172.21.15.100:0/2543139471 wait complete. 2024-09-12T02:05:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:19 smithi189 ceph-mon[35188]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 5 op/s 2024-09-12T02:05:19.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:19 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2543139471' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:05:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:19 smithi117 ceph-mon[35240]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 5 op/s 2024-09-12T02:05:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:19 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2543139471' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:05:19.407 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:19 smithi100 ceph-mon[31179]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 5 op/s 2024-09-12T02:05:19.408 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:19 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2543139471' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:05:19.760 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T02:05:19.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T02:05:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:20.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:20 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2543139471' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:05:20.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:20 smithi189 ceph-mon[35188]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:05:20.387 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:20 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2543139471' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:05:20.387 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:20 smithi100 ceph-mon[31179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:05:20.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:20 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2543139471' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:05:20.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:20 smithi117 ceph-mon[35240]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:05:20.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 -- 172.21.15.100:0/558239859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 msgr2=0x7f64e010b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 --2- 172.21.15.100:0/558239859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e010b9a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009900 tx=0x7f64d402a4a0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 -- 172.21.15.100:0/558239859 shutdown_connections 2024-09-12T02:05:20.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 --2- 172.21.15.100:0/558239859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e010bfc0 0x7f64e010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 --2- 172.21.15.100:0/558239859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e010b9a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 --2- 172.21.15.100:0/558239859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64e0102b90 0x7f64e0102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 -- 172.21.15.100:0/558239859 >> 172.21.15.100:0/558239859 conn(0x7f64e00fc610 msgr2=0x7f64e00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 -- 172.21.15.100:0/558239859 shutdown_connections 2024-09-12T02:05:20.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 -- 172.21.15.100:0/558239859 wait complete. 2024-09-12T02:05:20.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.471+0000 7f64dffff640 1 Processor -- start 2024-09-12T02:05:20.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64dffff640 1 -- start start 2024-09-12T02:05:20.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64dffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e0102b90 0x7f64e0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64dffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64dffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64e010bfc0 0x7f64e019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64dffff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0111e20 con 0x7f64e01034b0 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64dffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0111ca0 con 0x7f64e0102b90 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64dffff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0111fa0 con 0x7f64e010bfc0 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e0198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42342/0 (socket says 172.21.15.100:42342) 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 -- 172.21.15.100:0/2170234690 learned_addr learned my addr 172.21.15.100:0/2170234690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64deffd640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e0102b90 0x7f64e0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64df7fe640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64e010bfc0 0x7f64e019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 -- 172.21.15.100:0/2170234690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64e010bfc0 msgr2=0x7f64e019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64e010bfc0 0x7f64e019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 -- 172.21.15.100:0/2170234690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e0102b90 msgr2=0x7f64e0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e0102b90 0x7f64e0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64de7fc640 1 -- 172.21.15.100:0/2170234690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e019d2b0 con 0x7f64e01034b0 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.472+0000 7f64df7fe640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64e010bfc0 0x7f64e019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.473+0000 7f64de7fc640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e0198840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f64d4005ab0 tx=0x7f64d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.473+0000 7f64c7fff640 1 -- 172.21.15.100:0/2170234690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d403f030 con 0x7f64e01034b0 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.473+0000 7f64c7fff640 1 -- 172.21.15.100:0/2170234690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64d4003ce0 con 0x7f64e01034b0 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.473+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e019d540 con 0x7f64e01034b0 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.473+0000 7f64c7fff640 1 -- 172.21.15.100:0/2170234690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4035070 con 0x7f64e01034b0 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.473+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e01a4e80 con 0x7f64e01034b0 2024-09-12T02:05:20.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.474+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e006b070 con 0x7f64e01034b0 2024-09-12T02:05:20.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.475+0000 7f64c7fff640 1 -- 172.21.15.100:0/2170234690 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f64d4042030 con 0x7f64e01034b0 2024-09-12T02:05:20.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.476+0000 7f64c7fff640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f64c80a2b80 0x7f64c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.476+0000 7f64c7fff640 1 -- 172.21.15.100:0/2170234690 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f64d40ef350 con 0x7f64e01034b0 2024-09-12T02:05:20.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.476+0000 7f64deffd640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f64c80a2b80 0x7f64c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.476+0000 7f64deffd640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f64c80a2b80 0x7f64c80a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f64d0006fd0 tx=0x7f64d00090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.480+0000 7f64c7fff640 1 -- 172.21.15.100:0/2170234690 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64d40bc400 con 0x7f64e01034b0 2024-09-12T02:05:20.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.667+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f64e0062630 con 0x7f64c80a2b80 2024-09-12T02:05:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.693+0000 7f64c7fff640 1 -- 172.21.15.100:0/2170234690 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f64e0062630 con 0x7f64c80a2b80 2024-09-12T02:05:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f64c80a2b80 msgr2=0x7f64c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f64c80a2b80 0x7f64c80a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f64d0006fd0 tx=0x7f64d00090e0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 msgr2=0x7f64e0198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e0198840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f64d4005ab0 tx=0x7f64d40042f0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 shutdown_connections 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f64c80a2b80 0x7f64c80a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64e010bfc0 0x7f64e019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64e01034b0 0x7f64e0198840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 --2- 172.21.15.100:0/2170234690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64e0102b90 0x7f64e0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 >> 172.21.15.100:0/2170234690 conn(0x7f64e00fc610 msgr2=0x7f64e00fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 shutdown_connections 2024-09-12T02:05:20.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:20.695+0000 7f64dffff640 1 -- 172.21.15.100:0/2170234690 wait complete. 2024-09-12T02:05:21.069 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:05:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T02:05:20.672+0000 7f90c163a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:05:21.069 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:05:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T02:05:20.672+0000 7f90c163a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:05:21.069 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:05:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T02:05:20.672+0000 7f90c163a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:05:21.069 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:05:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T02:05:20.672+0000 7f90c163a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:05:21.070 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:05:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T02:05:20.672+0000 7f90c163a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:05:21.360 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:21 smithi100 ceph-mon[31179]: pgmap v279: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:05:21.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T02:05:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:21 smithi117 ceph-mon[35240]: pgmap v279: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:05:21.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:21 smithi189 ceph-mon[35188]: pgmap v279: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:05:21.610 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:22.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 -- 172.21.15.100:0/1810590894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100480 msgr2=0x7fac64100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 --2- 172.21.15.100:0/1810590894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100480 0x7fac64100860 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac54009900 tx=0x7fac5402a410 comp rx=0 tx=0).stop 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 -- 172.21.15.100:0/1810590894 shutdown_connections 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 --2- 172.21.15.100:0/1810590894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac641055b0 0x7fac6410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 --2- 172.21.15.100:0/1810590894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac64100e30 0x7fac64104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 --2- 172.21.15.100:0/1810590894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100480 0x7fac64100860 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 -- 172.21.15.100:0/1810590894 >> 172.21.15.100:0/1810590894 conn(0x7fac64077210 msgr2=0x7fac640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 -- 172.21.15.100:0/1810590894 shutdown_connections 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.055+0000 7fac6a233640 1 -- 172.21.15.100:0/1810590894 wait complete. 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 Processor -- start 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 -- start start 2024-09-12T02:05:22.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac64100480 0x7fac64199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100e30 0x7fac64199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac641055b0 0x7fac641a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac64110eb0 con 0x7fac64100e30 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fac64110d30 con 0x7fac64100480 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac6a233640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac64111030 con 0x7fac641055b0 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100e30 0x7fac64199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100e30 0x7fac64199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42386/0 (socket says 172.21.15.100:42386) 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 -- 172.21.15.100:0/2723460305 learned_addr learned my addr 172.21.15.100:0/2723460305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac63fff640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac641055b0 0x7fac641a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac637fe640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac64100480 0x7fac64199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 -- 172.21.15.100:0/2723460305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac641055b0 msgr2=0x7fac641a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac641055b0 0x7fac641a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 -- 172.21.15.100:0/2723460305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac64100480 msgr2=0x7fac64199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac64100480 0x7fac64199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.056+0000 7fac5bfff640 1 -- 172.21.15.100:0/2723460305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac641a4900 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.057+0000 7fac5bfff640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100e30 0x7fac64199880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b4a0 tx=0x7fac4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.057+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c014070 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.057+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4c010af0 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.057+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac641a4ad0 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.057+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c017d10 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.057+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac641a4fe0 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.058+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac64100860 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.059+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fac4c017070 con 0x7fac64100e30 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.060+0000 7fac617fa640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fac500a2b80 0x7fac500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.060+0000 7fac637fe640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fac500a2b80 0x7fac500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:22.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.060+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fac4c0ce700 con 0x7fac64100e30 2024-09-12T02:05:22.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.060+0000 7fac637fe640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fac500a2b80 0x7fac500a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac540096c0 tx=0x7fac54031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:22.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.063+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac4c09b7b0 con 0x7fac64100e30 2024-09-12T02:05:22.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.125+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fac4c010ca0 con 0x7fac64100e30 2024-09-12T02:05:22.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.265+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fac64108800 con 0x7fac500a2b80 2024-09-12T02:05:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.288+0000 7fac617fa640 1 -- 172.21.15.100:0/2723460305 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fac54031860 con 0x7fac500a2b80 2024-09-12T02:05:22.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fac500a2b80 msgr2=0x7fac500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fac500a2b80 0x7fac500a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac540096c0 tx=0x7fac54031490 comp rx=0 tx=0).stop 2024-09-12T02:05:22.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100e30 msgr2=0x7fac64199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:22.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100e30 0x7fac64199880 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b4a0 tx=0x7fac4c00b960 comp rx=0 tx=0).stop 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 shutdown_connections 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fac500a2b80 0x7fac500a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac641055b0 0x7fac641a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac64100e30 0x7fac64199880 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 --2- 172.21.15.100:0/2723460305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac64100480 0x7fac64199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 >> 172.21.15.100:0/2723460305 conn(0x7fac64077210 msgr2=0x7fac641037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 shutdown_connections 2024-09-12T02:05:22.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:22.290+0000 7fac6a233640 1 -- 172.21.15.100:0/2723460305 wait complete. 2024-09-12T02:05:22.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:22.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T02:05:22.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-12T02:05:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T02:05:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T02:05:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T02:05:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T02:05:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-12T02:05:22.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:22 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:05:22.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:22.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T02:05:22.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-12T02:05:22.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T02:05:22.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T02:05:22.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T02:05:22.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T02:05:22.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-12T02:05:22.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:22 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T02:05:22.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-12T02:05:22.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:22 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:05:22.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T02:05:23.253 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:05:23.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:23 smithi100 ceph-mon[31179]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T02:05:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-12T02:05:23.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:05:23.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:05:23.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:23 smithi117 ceph-mon[35240]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:05:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:05:23.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:23 smithi189 ceph-mon[35188]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:05:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 -- 172.21.15.100:0/3975430303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 msgr2=0x7f67701021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 --2- 172.21.15.100:0/3975430303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f67701021b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6760009900 tx=0x7f676002a410 comp rx=0 tx=0).stop 2024-09-12T02:05:23.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 -- 172.21.15.100:0/3975430303 shutdown_connections 2024-09-12T02:05:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 --2- 172.21.15.100:0/3975430303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6770106f00 0x7f677010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 --2- 172.21.15.100:0/3975430303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770102780 0x7f67701067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 --2- 172.21.15.100:0/3975430303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f67701021b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 -- 172.21.15.100:0/3975430303 >> 172.21.15.100:0/3975430303 conn(0x7f67700fd890 msgr2=0x7f67700ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 -- 172.21.15.100:0/3975430303 shutdown_connections 2024-09-12T02:05:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 -- 172.21.15.100:0/3975430303 wait complete. 2024-09-12T02:05:23.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.688+0000 7f6775725640 1 Processor -- start 2024-09-12T02:05:23.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f6775725640 1 -- start start 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f6775725640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f6770198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f6775725640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6770102780 0x7f6770198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f6775725640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770106f00 0x7f677019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f6775725640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6770112000 con 0x7f6770101dd0 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f6775725640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6770111e80 con 0x7f6770106f00 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f6775725640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6770112180 con 0x7f6770102780 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f6770198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f6770198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46976/0 (socket says 172.21.15.100:46976) 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 -- 172.21.15.100:0/3496390577 learned_addr learned my addr 172.21.15.100:0/3496390577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676f7fe640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770106f00 0x7f677019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 -- 172.21.15.100:0/3496390577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6770102780 msgr2=0x7f6770198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6770102780 0x7f6770198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 -- 172.21.15.100:0/3496390577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770106f00 msgr2=0x7f677019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770106f00 0x7f677019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676effd640 1 -- 172.21.15.100:0/3496390577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677019d530 con 0x7f6770101dd0 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.689+0000 7f676f7fe640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770106f00 0x7f677019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.690+0000 7f676effd640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f6770198580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6760005ab0 tx=0x7f67600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.690+0000 7f676cff9640 1 -- 172.21.15.100:0/3496390577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676003f030 con 0x7f6770101dd0 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.690+0000 7f676cff9640 1 -- 172.21.15.100:0/3496390577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6760003ce0 con 0x7f6770101dd0 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.690+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677019d7c0 con 0x7f6770101dd0 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.690+0000 7f676cff9640 1 -- 172.21.15.100:0/3496390577 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760035070 con 0x7f6770101dd0 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.690+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67701a5100 con 0x7f6770101dd0 2024-09-12T02:05:23.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.691+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67701032b0 con 0x7f6770101dd0 2024-09-12T02:05:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.692+0000 7f676cff9640 1 -- 172.21.15.100:0/3496390577 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6760042030 con 0x7f6770101dd0 2024-09-12T02:05:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.693+0000 7f676cff9640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f675c0a2c10 0x7f675c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.693+0000 7f67667fc640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f675c0a2c10 0x7f675c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.693+0000 7f676cff9640 1 -- 172.21.15.100:0/3496390577 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f67600efb60 con 0x7f6770101dd0 2024-09-12T02:05:23.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.693+0000 7f67667fc640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f675c0a2c10 0x7f675c0a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67700fff20 tx=0x7f6758006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:23.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.697+0000 7f676cff9640 1 -- 172.21.15.100:0/3496390577 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67600bc970 con 0x7f6770101dd0 2024-09-12T02:05:23.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.891+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f6770062630 con 0x7f675c0a2c10 2024-09-12T02:05:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.895+0000 7f676cff9640 1 -- 172.21.15.100:0/3496390577 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f6770062630 con 0x7f675c0a2c10 2024-09-12T02:05:23.896 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_0/9ff51236-f6e3-45b2-94b9-13bec13977a8 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.897+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f675c0a2c10 msgr2=0x7f675c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.897+0000 7f6775725640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f675c0a2c10 0x7f675c0a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67700fff20 tx=0x7f6758006c90 comp rx=0 tx=0).stop 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.897+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 msgr2=0x7f6770198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.897+0000 7f6775725640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f6770198580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6760005ab0 tx=0x7f67600042f0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 shutdown_connections 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f675c0a2c10 0x7f675c0a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770106f00 0x7f677019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6770102780 0x7f6770198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 --2- 172.21.15.100:0/3496390577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6770101dd0 0x7f6770198580 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 >> 172.21.15.100:0/3496390577 conn(0x7f67700fd890 msgr2=0x7f67700fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 shutdown_connections 2024-09-12T02:05:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:23.898+0000 7f6775725640 1 -- 172.21.15.100:0/3496390577 wait complete. 2024-09-12T02:05:24.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:24 smithi117 ceph-mon[35240]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:24.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:24 smithi117 ceph-mon[35240]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:05:24.482 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:24 smithi100 ceph-mon[31179]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:24.482 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:24 smithi100 ceph-mon[31179]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:05:24.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T02:05:24.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:24 smithi189 ceph-mon[35188]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:24.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:24 smithi189 ceph-mon[35188]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:05:24.755 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:25.186 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:25 smithi100 ceph-mon[31179]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:25.186 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:25 smithi100 ceph-mon[31179]: pgmap v283: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.9 KiB/s wr, 17 op/s 2024-09-12T02:05:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 -- 172.21.15.100:0/2455963194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804100ca0 msgr2=0x7f0804106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 --2- 172.21.15.100:0/2455963194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804100ca0 0x7f0804106840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009930 tx=0x7f07ec02a420 comp rx=0 tx=0).stop 2024-09-12T02:05:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 -- 172.21.15.100:0/2455963194 shutdown_connections 2024-09-12T02:05:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 --2- 172.21.15.100:0/2455963194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0804106f50 0x7f080410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 --2- 172.21.15.100:0/2455963194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804100ca0 0x7f0804106840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 --2- 172.21.15.100:0/2455963194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08041002f0 0x7f08041006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 -- 172.21.15.100:0/2455963194 >> 172.21.15.100:0/2455963194 conn(0x7f0804077210 msgr2=0x7f08040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 -- 172.21.15.100:0/2455963194 shutdown_connections 2024-09-12T02:05:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.195+0000 7f080931c640 1 -- 172.21.15.100:0/2455963194 wait complete. 2024-09-12T02:05:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.196+0000 7f080931c640 1 Processor -- start 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.196+0000 7f080931c640 1 -- start start 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f080931c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08041002f0 0x7f0804198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f080931c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0804100ca0 0x7f0804198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f080931c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804106f50 0x7f080419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f080931c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0804111fe0 con 0x7f0804106f50 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f080931c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0804111e60 con 0x7f0804100ca0 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f080931c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0804112160 con 0x7f08041002f0 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804106f50 0x7f080419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804106f50 0x7f080419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47008/0 (socket says 172.21.15.100:47008) 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 -- 172.21.15.100:0/132797930 learned_addr learned my addr 172.21.15.100:0/132797930 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08027fc640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0804100ca0 0x7f0804198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f0802ffd640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08041002f0 0x7f0804198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 -- 172.21.15.100:0/132797930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08041002f0 msgr2=0x7f0804198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08041002f0 0x7f0804198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 -- 172.21.15.100:0/132797930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0804100ca0 msgr2=0x7f0804198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0804100ca0 0x7f0804198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 -- 172.21.15.100:0/132797930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080419d4b0 con 0x7f0804106f50 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f08037fe640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804106f50 0x7f080419cdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b970 tx=0x7f07fc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f07fbfff640 1 -- 172.21.15.100:0/132797930 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc019070 con 0x7f0804106f50 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080419d7a0 con 0x7f0804106f50 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f07fbfff640 1 -- 172.21.15.100:0/132797930 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07fc014440 con 0x7f0804106f50 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.197+0000 7f07fbfff640 1 -- 172.21.15.100:0/132797930 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0075d0 con 0x7f0804106f50 2024-09-12T02:05:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.198+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08041a5080 con 0x7f0804106f50 2024-09-12T02:05:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.198+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08041006d0 con 0x7f0804106f50 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.199+0000 7f07fbfff640 1 -- 172.21.15.100:0/132797930 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f07fc01c070 con 0x7f0804106f50 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.200+0000 7f07fbfff640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f07f00a2c10 0x7f07f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.200+0000 7f0802ffd640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f07f00a2c10 0x7f07f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.201+0000 7f07fbfff640 1 -- 172.21.15.100:0/132797930 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f07fc0ce600 con 0x7f0804106f50 2024-09-12T02:05:25.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.201+0000 7f0802ffd640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f07f00a2c10 0x7f07f00a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f07f400abe0 tx=0x7f07f400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.205+0000 7f07fbfff640 1 -- 172.21.15.100:0/132797930 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07fc09aed0 con 0x7f0804106f50 2024-09-12T02:05:25.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.395+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f080410a180 con 0x7f07f00a2c10 2024-09-12T02:05:25.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:25 smithi117 ceph-mon[35240]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:25 smithi117 ceph-mon[35240]: pgmap v283: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.9 KiB/s wr, 17 op/s 2024-09-12T02:05:25.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.420+0000 7f07fbfff640 1 -- 172.21.15.100:0/132797930 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f080410a180 con 0x7f07f00a2c10 2024-09-12T02:05:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f07f00a2c10 msgr2=0x7f07f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f07f00a2c10 0x7f07f00a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f07f400abe0 tx=0x7f07f400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804106f50 msgr2=0x7f080419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804106f50 0x7f080419cdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b970 tx=0x7f07fc00bd70 comp rx=0 tx=0).stop 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 shutdown_connections 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f07f00a2c10 0x7f07f00a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804106f50 0x7f080419cdd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0804100ca0 0x7f0804198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 --2- 172.21.15.100:0/132797930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08041002f0 0x7f0804198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 >> 172.21.15.100:0/132797930 conn(0x7f0804077210 msgr2=0x7f0804105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 shutdown_connections 2024-09-12T02:05:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:25.422+0000 7f080931c640 1 -- 172.21.15.100:0/132797930 wait complete. 2024-09-12T02:05:25.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:25 smithi189 ceph-mon[35188]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:25.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:25 smithi189 ceph-mon[35188]: pgmap v283: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.9 KiB/s wr, 17 op/s 2024-09-12T02:05:26.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T02:05:26.484 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/772283179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 msgr2=0x7f2c04106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/772283179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c04106e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009930 tx=0x7f2c0002a420 comp rx=0 tx=0).stop 2024-09-12T02:05:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/772283179 shutdown_connections 2024-09-12T02:05:26.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/772283179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c04101420 0x7f2c0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/772283179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c04100a80 0x7f2c04100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/772283179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c04106e60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/772283179 >> 172.21.15.100:0/772283179 conn(0x7f2c040fc7a0 msgr2=0x7f2c040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/772283179 shutdown_connections 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.859+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/772283179 wait complete. 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 Processor -- start 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 -- start start 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c04100a80 0x7f2c04199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c04101420 0x7f2c04199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c041a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04110f20 con 0x7f2c04106a80 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04110da0 con 0x7f2c04100a80 2024-09-12T02:05:26.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c0b5b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c041110a0 con 0x7f2c04101420 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09b54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c041a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09b54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c041a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47028/0 (socket says 172.21.15.100:47028) 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09b54640 1 -- 172.21.15.100:0/2106279112 learned_addr learned my addr 172.21.15.100:0/2106279112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c08b52640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c04101420 0x7f2c04199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09353640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c04100a80 0x7f2c04199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09b54640 1 -- 172.21.15.100:0/2106279112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c04101420 msgr2=0x7f2c04199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09b54640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c04101420 0x7f2c04199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09b54640 1 -- 172.21.15.100:0/2106279112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c04100a80 msgr2=0x7f2c04199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.860+0000 7f2c09b54640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c04100a80 0x7f2c04199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.861+0000 7f2c09b54640 1 -- 172.21.15.100:0/2106279112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c041a4a10 con 0x7f2c04106a80 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.861+0000 7f2c09b54640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c041a44d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b970 tx=0x7f2bfc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.861+0000 7f2bfa7fc640 1 -- 172.21.15.100:0/2106279112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc019070 con 0x7f2c04106a80 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.861+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c041a4be0 con 0x7f2c04106a80 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.861+0000 7f2bfa7fc640 1 -- 172.21.15.100:0/2106279112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bfc014440 con 0x7f2c04106a80 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.861+0000 7f2bfa7fc640 1 -- 172.21.15.100:0/2106279112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0075d0 con 0x7f2c04106a80 2024-09-12T02:05:26.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.861+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c041a50a0 con 0x7f2c04106a80 2024-09-12T02:05:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.862+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c04100f60 con 0x7f2c04106a80 2024-09-12T02:05:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.863+0000 7f2bfa7fc640 1 -- 172.21.15.100:0/2106279112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2bfc01c070 con 0x7f2c04106a80 2024-09-12T02:05:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.864+0000 7f2bfa7fc640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2bf00a2c10 0x7f2bf00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.864+0000 7f2c09353640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2bf00a2c10 0x7f2bf00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.864+0000 7f2bfa7fc640 1 -- 172.21.15.100:0/2106279112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2bfc0ce740 con 0x7f2c04106a80 2024-09-12T02:05:26.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.864+0000 7f2c09353640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2bf00a2c10 0x7f2bf00a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c00000c00 tx=0x7f2c00031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:26.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:26.868+0000 7f2bfa7fc640 1 -- 172.21.15.100:0/2106279112 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bfc09b600 con 0x7f2c04106a80 2024-09-12T02:05:27.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.060+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f2c04062630 con 0x7f2bf00a2c10 2024-09-12T02:05:27.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.064+0000 7f2bfa7fc640 1 -- 172.21.15.100:0/2106279112 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2c04062630 con 0x7f2bf00a2c10 2024-09-12T02:05:27.064 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_1/80bbd05c-1c24-4a8b-97b9-49391beb9e7d 2024-09-12T02:05:27.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2bf00a2c10 msgr2=0x7f2bf00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2bf00a2c10 0x7f2bf00a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c00000c00 tx=0x7f2c00031490 comp rx=0 tx=0).stop 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 msgr2=0x7f2c041a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c041a44d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b970 tx=0x7f2bfc00bd70 comp rx=0 tx=0).stop 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 shutdown_connections 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2bf00a2c10 0x7f2bf00a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c04106a80 0x7f2c041a44d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c04101420 0x7f2c04199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 --2- 172.21.15.100:0/2106279112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c04100a80 0x7f2c04199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.066+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 >> 172.21.15.100:0/2106279112 conn(0x7f2c040fc7a0 msgr2=0x7f2c040fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.067+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 shutdown_connections 2024-09-12T02:05:27.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:27.067+0000 7f2c0b5b7640 1 -- 172.21.15.100:0/2106279112 wait complete. 2024-09-12T02:05:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:27 smithi117 ceph-mon[35240]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:27 smithi117 ceph-mon[35240]: pgmap v284: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 18 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:05:27.422 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:27 smithi100 ceph-mon[31179]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:27.422 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:27 smithi100 ceph-mon[31179]: pgmap v284: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 18 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:05:27.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:27 smithi189 ceph-mon[35188]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:27.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:27 smithi189 ceph-mon[35188]: pgmap v284: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 18 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:05:27.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:05:27.995 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:28.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:28 smithi117 ceph-mon[35240]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:28.417 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:28 smithi100 ceph-mon[31179]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 -- 172.21.15.100:0/9653033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8101420 msgr2=0x7fc9e810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 --2- 172.21.15.100:0/9653033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8101420 0x7fc9e810d950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009cd0 tx=0x7fc9e002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 -- 172.21.15.100:0/9653033 shutdown_connections 2024-09-12T02:05:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 --2- 172.21.15.100:0/9653033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8101420 0x7fc9e810d950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 --2- 172.21.15.100:0/9653033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e8100a80 0x7fc9e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 --2- 172.21.15.100:0/9653033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e8106a80 0x7fc9e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 -- 172.21.15.100:0/9653033 >> 172.21.15.100:0/9653033 conn(0x7fc9e80fc7a0 msgr2=0x7fc9e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 -- 172.21.15.100:0/9653033 shutdown_connections 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.437+0000 7fc9f028a640 1 -- 172.21.15.100:0/9653033 wait complete. 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 Processor -- start 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 -- start start 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8100a80 0x7fc9e8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e8101420 0x7fc9e8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e8106a80 0x7fc9e81a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8110ea0 con 0x7fc9e8100a80 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8110d20 con 0x7fc9e8101420 2024-09-12T02:05:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9f028a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8111020 con 0x7fc9e8106a80 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8100a80 0x7fc9e8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8100a80 0x7fc9e8199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47050/0 (socket says 172.21.15.100:47050) 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 -- 172.21.15.100:0/761323687 learned_addr learned my addr 172.21.15.100:0/761323687 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee827640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e8106a80 0x7fc9e81a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 -- 172.21.15.100:0/761323687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e8106a80 msgr2=0x7fc9e81a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e8106a80 0x7fc9e81a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 -- 172.21.15.100:0/761323687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e8101420 msgr2=0x7fc9e8199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e8101420 0x7fc9e8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.438+0000 7fc9ee026640 1 -- 172.21.15.100:0/761323687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e81a4810 con 0x7fc9e8100a80 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.439+0000 7fc9ee026640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8100a80 0x7fc9e8199250 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400c920 tx=0x7fc9e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.439+0000 7fc9df7fe640 1 -- 172.21.15.100:0/761323687 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4007c70 con 0x7fc9e8100a80 2024-09-12T02:05:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.439+0000 7fc9df7fe640 1 -- 172.21.15.100:0/761323687 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9e4007e10 con 0x7fc9e8100a80 2024-09-12T02:05:28.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.439+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e81a49e0 con 0x7fc9e8100a80 2024-09-12T02:05:28.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.439+0000 7fc9df7fe640 1 -- 172.21.15.100:0/761323687 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4018890 con 0x7fc9e8100a80 2024-09-12T02:05:28.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.439+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e81a4f20 con 0x7fc9e8100a80 2024-09-12T02:05:28.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.440+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e8100ee0 con 0x7fc9e8100a80 2024-09-12T02:05:28.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.441+0000 7fc9df7fe640 1 -- 172.21.15.100:0/761323687 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc9e4018b30 con 0x7fc9e8100a80 2024-09-12T02:05:28.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.442+0000 7fc9df7fe640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9d40a2c90 0x7fc9d40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:28.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.442+0000 7fc9ed825640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9d40a2c90 0x7fc9d40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:28.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.442+0000 7fc9df7fe640 1 -- 172.21.15.100:0/761323687 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc9e40cf360 con 0x7fc9e8100a80 2024-09-12T02:05:28.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.442+0000 7fc9ed825640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9d40a2c90 0x7fc9d40a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9e806b2e0 tx=0x7fc9d8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.446+0000 7fc9df7fe640 1 -- 172.21.15.100:0/761323687 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9e4014030 con 0x7fc9e8100a80 2024-09-12T02:05:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:28 smithi189 ceph-mon[35188]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:28.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.646+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9e806ad80 con 0x7fc9e8100a80 2024-09-12T02:05:28.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.647+0000 7fc9df7fe640 1 -- 172.21.15.100:0/761323687 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11929 (secure 0 0 0) 0x7fc9e400de20 con 0x7fc9e8100a80 2024-09-12T02:05:28.647 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:28.647 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"btime":"2024-09-12T02:05:19:082439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:05:18.350451+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24433,24428]},"id":1}]} 2024-09-12T02:05:28.647 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-12T02:05:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9d40a2c90 msgr2=0x7fc9d40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9d40a2c90 0x7fc9d40a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9e806b2e0 tx=0x7fc9d8006c90 comp rx=0 tx=0).stop 2024-09-12T02:05:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8100a80 msgr2=0x7fc9e8199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8100a80 0x7fc9e8199250 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400c920 tx=0x7fc9e400cde0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 shutdown_connections 2024-09-12T02:05:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9d40a2c90 0x7fc9d40a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e8106a80 0x7fc9e81a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e8101420 0x7fc9e8199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 --2- 172.21.15.100:0/761323687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9e8100a80 0x7fc9e8199250 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 >> 172.21.15.100:0/761323687 conn(0x7fc9e80fc7a0 msgr2=0x7fc9e80fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 shutdown_connections 2024-09-12T02:05:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:28.649+0000 7fc9f028a640 1 -- 172.21.15.100:0/761323687 wait complete. 2024-09-12T02:05:29.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:05:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:29 smithi117 ceph-mon[35240]: pgmap v285: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-09-12T02:05:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:29 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/761323687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:05:29.495 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:29.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:29 smithi100 ceph-mon[31179]: pgmap v285: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-09-12T02:05:29.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:29 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/761323687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:05:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:29 smithi189 ceph-mon[35188]: pgmap v285: 97 pgs: 97 active+clean; 602 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-09-12T02:05:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:29 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/761323687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 -- 172.21.15.100:0/3832350821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 msgr2=0x7f981c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 --2- 172.21.15.100:0/3832350821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c10bb50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f980c009900 tx=0x7f980c02a480 comp rx=0 tx=0).stop 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 -- 172.21.15.100:0/3832350821 shutdown_connections 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 --2- 172.21.15.100:0/3832350821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c10c170 0x7f981c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 --2- 172.21.15.100:0/3832350821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c10bb50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 --2- 172.21.15.100:0/3832350821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c102d40 0x7f981c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 -- 172.21.15.100:0/3832350821 >> 172.21.15.100:0/3832350821 conn(0x7f981c0fc7a0 msgr2=0x7f981c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 -- 172.21.15.100:0/3832350821 shutdown_connections 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.962+0000 7f9823cb2640 1 -- 172.21.15.100:0/3832350821 wait complete. 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 Processor -- start 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 -- start start 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102d40 0x7f981c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c10c170 0x7f981c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f981c111fb0 con 0x7f981c103660 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f981c111e30 con 0x7f981c102d40 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f9823cb2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f981c112130 con 0x7f981c10c170 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f982124d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f982124d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47076/0 (socket says 172.21.15.100:47076) 2024-09-12T02:05:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.963+0000 7f982124d640 1 -- 172.21.15.100:0/1799567723 learned_addr learned my addr 172.21.15.100:0/1799567723 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f9821a4e640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102d40 0x7f981c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f982124d640 1 -- 172.21.15.100:0/1799567723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c10c170 msgr2=0x7f981c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f982124d640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c10c170 0x7f981c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f982124d640 1 -- 172.21.15.100:0/1799567723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102d40 msgr2=0x7f981c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f982124d640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102d40 0x7f981c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f982124d640 1 -- 172.21.15.100:0/1799567723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c19d460 con 0x7f981c103660 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f982124d640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c1989f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f980c005ab0 tx=0x7f980c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f9812ffd640 1 -- 172.21.15.100:0/1799567723 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c03f030 con 0x7f981c103660 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c19d6f0 con 0x7f981c103660 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f9812ffd640 1 -- 172.21.15.100:0/1799567723 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f980c003ce0 con 0x7f981c103660 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f9812ffd640 1 -- 172.21.15.100:0/1799567723 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c035070 con 0x7f981c103660 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.964+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c1a5030 con 0x7f981c103660 2024-09-12T02:05:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.965+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c06b070 con 0x7f981c103660 2024-09-12T02:05:29.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.967+0000 7f9812ffd640 1 -- 172.21.15.100:0/1799567723 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f980c042030 con 0x7f981c103660 2024-09-12T02:05:29.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.967+0000 7f9812ffd640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98080a2c90 0x7f98080a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.968+0000 7f9821a4e640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98080a2c90 0x7f98080a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.968+0000 7f9812ffd640 1 -- 172.21.15.100:0/1799567723 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f980c0efb30 con 0x7f981c103660 2024-09-12T02:05:29.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.968+0000 7f9821a4e640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98080a2c90 0x7f98080a5150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9818009890 tx=0x7f9818008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:29.972+0000 7f9812ffd640 1 -- 172.21.15.100:0/1799567723 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f980c0bc8e0 con 0x7f981c103660 2024-09-12T02:05:30.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.141+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f981c103120 con 0x7f981c103660 2024-09-12T02:05:30.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.143+0000 7f9812ffd640 1 -- 172.21.15.100:0/1799567723 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7f981c103120 con 0x7f981c103660 2024-09-12T02:05:30.144 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:30.144 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:05:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98080a2c90 msgr2=0x7f98080a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98080a2c90 0x7f98080a5150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9818009890 tx=0x7f9818008040 comp rx=0 tx=0).stop 2024-09-12T02:05:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 msgr2=0x7f981c1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c1989f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f980c005ab0 tx=0x7f980c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 shutdown_connections 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98080a2c90 0x7f98080a5150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f981c10c170 0x7f981c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981c103660 0x7f981c1989f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 --2- 172.21.15.100:0/1799567723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f981c102d40 0x7f981c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 >> 172.21.15.100:0/1799567723 conn(0x7f981c0fc7a0 msgr2=0x7f981c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.145+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 shutdown_connections 2024-09-12T02:05:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:30.146+0000 7f9823cb2640 1 -- 172.21.15.100:0/1799567723 wait complete. 2024-09-12T02:05:30.675 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:05:30.675 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:05:30.928 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:31.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:31 smithi100 ceph-mon[31179]: pgmap v286: 97 pgs: 97 active+clean; 626 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 KiB/s wr, 9 op/s; 72 B/s, 0 objects/s recovering 2024-09-12T02:05:31.287 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:31 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1799567723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:31.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3793615404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc010bfc0 msgr2=0x7f3bc010e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:31.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3793615404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc010bfc0 0x7f3bc010e460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009ca0 tx=0x7f3bb802a950 comp rx=0 tx=0).stop 2024-09-12T02:05:31.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3793615404 shutdown_connections 2024-09-12T02:05:31.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3793615404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc010bfc0 0x7f3bc010e460 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3793615404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bc01034b0 0x7f3bc010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3793615404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bc0102b90 0x7f3bc0102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3793615404 >> 172.21.15.100:0/3793615404 conn(0x7f3bc00fc610 msgr2=0x7f3bc00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3793615404 shutdown_connections 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.363+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3793615404 wait complete. 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.364+0000 7f3bc4d9e640 1 Processor -- start 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.364+0000 7f3bc4d9e640 1 -- start start 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bc4d9e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc0102b90 0x7f3bc0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bc4d9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bc01034b0 0x7f3bc01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bc4d9e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bc010bfc0 0x7f3bc019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bc4d9e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0111e80 con 0x7f3bc0102b90 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bc4d9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0111d00 con 0x7f3bc01034b0 2024-09-12T02:05:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bc4d9e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0112000 con 0x7f3bc010bfc0 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc0102b90 0x7f3bc0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc0102b90 0x7f3bc0198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47088/0 (socket says 172.21.15.100:47088) 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 -- 172.21.15.100:0/3438206919 learned_addr learned my addr 172.21.15.100:0/3438206919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbeffd640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bc01034b0 0x7f3bc01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbffff640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bc010bfc0 0x7f3bc019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 -- 172.21.15.100:0/3438206919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bc010bfc0 msgr2=0x7f3bc019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bc010bfc0 0x7f3bc019cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 -- 172.21.15.100:0/3438206919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bc01034b0 msgr2=0x7f3bc01988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bc01034b0 0x7f3bc01988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 -- 172.21.15.100:0/3438206919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc019d330 con 0x7f3bc0102b90 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbf7fe640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc0102b90 0x7f3bc0198380 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b4a0 tx=0x7f3ba800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbcff9640 1 -- 172.21.15.100:0/3438206919 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8014070 con 0x7f3bc0102b90 2024-09-12T02:05:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc019d620 con 0x7f3bc0102b90 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbcff9640 1 -- 172.21.15.100:0/3438206919 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ba8010af0 con 0x7f3bc0102b90 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.365+0000 7f3bbcff9640 1 -- 172.21.15.100:0/3438206919 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8017d10 con 0x7f3bc0102b90 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.366+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc01a4f00 con 0x7f3bc0102b90 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.366+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc0102ff0 con 0x7f3bc0102b90 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.368+0000 7f3bbcff9640 1 -- 172.21.15.100:0/3438206919 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3ba8017070 con 0x7f3bc0102b90 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.369+0000 7f3bbcff9640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3bac0a2c10 0x7f3bac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.369+0000 7f3bbeffd640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3bac0a2c10 0x7f3bac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.369+0000 7f3bbcff9640 1 -- 172.21.15.100:0/3438206919 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3ba80ce4d0 con 0x7f3bc0102b90 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.369+0000 7f3bbeffd640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3bac0a2c10 0x7f3bac0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00fec30 tx=0x7f3bb0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:31.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.373+0000 7f3bbcff9640 1 -- 172.21.15.100:0/3438206919 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ba809b3f0 con 0x7f3bc0102b90 2024-09-12T02:05:31.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:31 smithi189 ceph-mon[35188]: pgmap v286: 97 pgs: 97 active+clean; 626 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 KiB/s wr, 9 op/s; 72 B/s, 0 objects/s recovering 2024-09-12T02:05:31.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:31 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1799567723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:31.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:31 smithi117 ceph-mon[35240]: pgmap v286: 97 pgs: 97 active+clean; 626 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 KiB/s wr, 9 op/s; 72 B/s, 0 objects/s recovering 2024-09-12T02:05:31.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:31 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1799567723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:31.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.537+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bc00fe400 con 0x7f3bac0a2c10 2024-09-12T02:05:31.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.545+0000 7f3bbcff9640 1 -- 172.21.15.100:0/3438206919 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258709 (secure 0 0 0) 0x7f3bc00fe400 con 0x7f3bac0a2c10 2024-09-12T02:05:31.549 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:31.550 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:05:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3bac0a2c10 msgr2=0x7f3bac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3bac0a2c10 0x7f3bac0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00fec30 tx=0x7f3bb0008040 comp rx=0 tx=0).stop 2024-09-12T02:05:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc0102b90 msgr2=0x7f3bc0198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc0102b90 0x7f3bc0198380 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b4a0 tx=0x7f3ba800b960 comp rx=0 tx=0).stop 2024-09-12T02:05:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 shutdown_connections 2024-09-12T02:05:31.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f3bac0a2c10 0x7f3bac0a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bc010bfc0 0x7f3bc019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3bc01034b0 0x7f3bc01988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 --2- 172.21.15.100:0/3438206919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc0102b90 0x7f3bc0198380 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:31.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 >> 172.21.15.100:0/3438206919 conn(0x7f3bc00fc610 msgr2=0x7f3bc00fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:31.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 shutdown_connections 2024-09-12T02:05:31.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:31.548+0000 7f3bc4d9e640 1 -- 172.21.15.100:0/3438206919 wait complete. 2024-09-12T02:05:32.386 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-12T02:05:30.020498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641407,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":223,"num_read_kb":213,"num_write":327,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353496,"kb_used_data":12528,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588328,"statfs":{"total":1151940427776,"available":1151578447872,"internally_reserved":0,"allocated":12828672,"data_stored":7148875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45817,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":76,"num_write":21,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001743"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:27.778628+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:05:27.778628+0000","last_peered":"2024-09-12T02:05:27.778628+0000","last_clean":"2024-09-12T02:05:27.778628+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:05:27.778628+0000","last_undegraded":"2024-09-12T02:05:27.778628+0000","last_fullsized":"2024-09-12T02:05:27.778628+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:26.776565+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:05:26.776565+0000","last_peered":"2024-09-12T02:05:26.776565+0000","last_clean":"2024-09-12T02:05:26.776565+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:05:26.776565+0000","last_undegraded":"2024-09-12T02:05:26.776565+0000","last_fullsized":"2024-09-12T02:05:26.776565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'22","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:27.778894+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:05:27.778894+0000","last_peered":"2024-09-12T02:05:27.778894+0000","last_clean":"2024-09-12T02:05:27.778894+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:05:27.778894+0000","last_undegraded":"2024-09-12T02:05:27.778894+0000","last_fullsized":"2024-09-12T02:05:27.778894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":60,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.773630+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:05:24.773630+0000","last_peered":"2024-09-12T02:05:24.773630+0000","last_clean":"2024-09-12T02:05:24.773630+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:05:24.773630+0000","last_undegraded":"2024-09-12T02:05:24.773630+0000","last_fullsized":"2024-09-12T02:05:24.773630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275002+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275002+0000","last_peered":"2024-09-12T02:05:23.275002+0000","last_clean":"2024-09-12T02:05:23.275002+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275002+0000","last_undegraded":"2024-09-12T02:05:23.275002+0000","last_fullsized":"2024-09-12T02:05:23.275002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.779014+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:05:28.779014+0000","last_peered":"2024-09-12T02:05:28.779014+0000","last_clean":"2024-09-12T02:05:28.779014+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:05:28.779014+0000","last_undegraded":"2024-09-12T02:05:28.779014+0000","last_fullsized":"2024-09-12T02:05:28.779014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116246+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:23.116246+0000","last_peered":"2024-09-12T02:05:23.116246+0000","last_clean":"2024-09-12T02:05:23.116246+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:23.116246+0000","last_undegraded":"2024-09-12T02:05:23.116246+0000","last_fullsized":"2024-09-12T02:05:23.116246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.127440+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:23.127440+0000","last_peered":"2024-09-12T02:05:23.127440+0000","last_clean":"2024-09-12T02:05:23.127440+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:23.127440+0000","last_undegraded":"2024-09-12T02:05:23.127440+0000","last_fullsized":"2024-09-12T02:05:23.127440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50805,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":97,"num_read_kb":104,"num_write":144,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1076292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234016,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1029781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":485390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":459759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":47963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:05:32.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:05:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 -- 172.21.15.100:0/4098681335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18105560 msgr2=0x7fcd1810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/4098681335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18105560 0x7fcd1810d0e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009ca0 tx=0x7fcd1002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 -- 172.21.15.100:0/4098681335 shutdown_connections 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/4098681335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18105560 0x7fcd1810d0e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/4098681335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18100de0 0x7fcd18104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/4098681335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd18100430 0x7fcd18100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 -- 172.21.15.100:0/4098681335 >> 172.21.15.100:0/4098681335 conn(0x7fcd18077230 msgr2=0x7fcd180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 -- 172.21.15.100:0/4098681335 shutdown_connections 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 -- 172.21.15.100:0/4098681335 wait complete. 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.070+0000 7fcd1d35a640 1 Processor -- start 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd1d35a640 1 -- start start 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd1d35a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18100430 0x7fcd180fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd1d35a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18100de0 0x7fcd180fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd1d35a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd18105560 0x7fcd180fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd1d35a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1810fd40 con 0x7fcd18100de0 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd1d35a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1810fbc0 con 0x7fcd18100430 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd1d35a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1810fec0 con 0x7fcd18105560 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18100de0 0x7fcd180fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18100de0 0x7fcd180fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47112/0 (socket says 172.21.15.100:47112) 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 -- 172.21.15.100:0/801793268 learned_addr learned my addr 172.21.15.100:0/801793268 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd16ffd640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18100430 0x7fcd180fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd177fe640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd18105560 0x7fcd180fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 -- 172.21.15.100:0/801793268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd18105560 msgr2=0x7fcd180fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd18105560 0x7fcd180fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 -- 172.21.15.100:0/801793268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18100430 msgr2=0x7fcd180fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18100430 0x7fcd180fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd0e7fc640 1 -- 172.21.15.100:0/801793268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd181a68f0 con 0x7fcd18100de0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.071+0000 7fcd16ffd640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18100430 0x7fcd180fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.072+0000 7fcd0e7fc640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18100de0 0x7fcd180fcc40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000ddc0 tx=0x7fcd0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.072+0000 7fcd14ff9640 1 -- 172.21.15.100:0/801793268 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0001b070 con 0x7fcd18100de0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.072+0000 7fcd14ff9640 1 -- 172.21.15.100:0/801793268 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd0000be40 con 0x7fcd18100de0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.072+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd181a6be0 con 0x7fcd18100de0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.072+0000 7fcd14ff9640 1 -- 172.21.15.100:0/801793268 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00016bb0 con 0x7fcd18100de0 2024-09-12T02:05:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.072+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd181a7170 con 0x7fcd18100de0 2024-09-12T02:05:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.073+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd18100810 con 0x7fcd18100de0 2024-09-12T02:05:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.074+0000 7fcd14ff9640 1 -- 172.21.15.100:0/801793268 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcd0001e070 con 0x7fcd18100de0 2024-09-12T02:05:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.075+0000 7fcd14ff9640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fccf80a2c90 0x7fccf80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.075+0000 7fcd16ffd640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fccf80a2c90 0x7fccf80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.075+0000 7fcd14ff9640 1 -- 172.21.15.100:0/801793268 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcd000cedb0 con 0x7fcd18100de0 2024-09-12T02:05:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.075+0000 7fcd16ffd640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fccf80a2c90 0x7fccf80a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd080058c0 tx=0x7fcd08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.079+0000 7fcd14ff9640 1 -- 172.21.15.100:0/801793268 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd0009bcd0 con 0x7fcd18100de0 2024-09-12T02:05:33.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.244+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd18062630 con 0x7fccf80a2c90 2024-09-12T02:05:33.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.251+0000 7fcd14ff9640 1 -- 172.21.15.100:0/801793268 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258711 (secure 0 0 0) 0x7fcd18062630 con 0x7fccf80a2c90 2024-09-12T02:05:33.254 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fccf80a2c90 msgr2=0x7fccf80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fccf80a2c90 0x7fccf80a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd080058c0 tx=0x7fcd08005850 comp rx=0 tx=0).stop 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18100de0 msgr2=0x7fcd180fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18100de0 0x7fcd180fcc40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000ddc0 tx=0x7fcd0000a620 comp rx=0 tx=0).stop 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 shutdown_connections 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fccf80a2c90 0x7fccf80a5150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd18105560 0x7fcd180fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd18100de0 0x7fcd180fcc40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 --2- 172.21.15.100:0/801793268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18100430 0x7fcd180fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:33.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 >> 172.21.15.100:0/801793268 conn(0x7fcd18077230 msgr2=0x7fcd180fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:33.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 shutdown_connections 2024-09-12T02:05:33.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:33.254+0000 7fcd1d35a640 1 -- 172.21.15.100:0/801793268 wait complete. 2024-09-12T02:05:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:33 smithi100 ceph-mon[31179]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:33 smithi100 ceph-mon[31179]: pgmap v287: 97 pgs: 97 active+clean; 626 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s; 58 B/s, 0 objects/s recovering 2024-09-12T02:05:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:33 smithi117 ceph-mon[35240]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:33 smithi117 ceph-mon[35240]: pgmap v287: 97 pgs: 97 active+clean; 626 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s; 58 B/s, 0 objects/s recovering 2024-09-12T02:05:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:33 smithi189 ceph-mon[35188]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:33 smithi189 ceph-mon[35188]: pgmap v287: 97 pgs: 97 active+clean; 626 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s; 58 B/s, 0 objects/s recovering 2024-09-12T02:05:33.914 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-12T02:05:32.020988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641407,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":228,"num_read_kb":213,"num_write":335,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353512,"kb_used_data":12552,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588312,"statfs":{"total":1151940427776,"available":1151578431488,"internally_reserved":0,"allocated":12853248,"data_stored":7173345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45817,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":76,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.908704"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:27.778628+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:05:27.778628+0000","last_peered":"2024-09-12T02:05:27.778628+0000","last_clean":"2024-09-12T02:05:27.778628+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:05:27.778628+0000","last_undegraded":"2024-09-12T02:05:27.778628+0000","last_fullsized":"2024-09-12T02:05:27.778628+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:26.776565+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:05:26.776565+0000","last_peered":"2024-09-12T02:05:26.776565+0000","last_clean":"2024-09-12T02:05:26.776565+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:05:26.776565+0000","last_undegraded":"2024-09-12T02:05:26.776565+0000","last_fullsized":"2024-09-12T02:05:26.776565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'22","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:27.778894+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:05:27.778894+0000","last_peered":"2024-09-12T02:05:27.778894+0000","last_clean":"2024-09-12T02:05:27.778894+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:05:27.778894+0000","last_undegraded":"2024-09-12T02:05:27.778894+0000","last_fullsized":"2024-09-12T02:05:27.778894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":60,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:29.781075+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:05:29.781075+0000","last_peered":"2024-09-12T02:05:29.781075+0000","last_clean":"2024-09-12T02:05:29.781075+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:05:29.781075+0000","last_undegraded":"2024-09-12T02:05:29.781075+0000","last_fullsized":"2024-09-12T02:05:29.781075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275002+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275002+0000","last_peered":"2024-09-12T02:05:23.275002+0000","last_clean":"2024-09-12T02:05:23.275002+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275002+0000","last_undegraded":"2024-09-12T02:05:23.275002+0000","last_fullsized":"2024-09-12T02:05:23.275002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.779014+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:05:28.779014+0000","last_peered":"2024-09-12T02:05:28.779014+0000","last_clean":"2024-09-12T02:05:28.779014+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:05:28.779014+0000","last_undegraded":"2024-09-12T02:05:28.779014+0000","last_fullsized":"2024-09-12T02:05:28.779014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.050328+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:28.050328+0000","last_peered":"2024-09-12T02:05:28.050328+0000","last_clean":"2024-09-12T02:05:28.050328+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:28.050328+0000","last_undegraded":"2024-09-12T02:05:28.050328+0000","last_fullsized":"2024-09-12T02:05:28.050328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.127440+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:23.127440+0000","last_peered":"2024-09-12T02:05:23.127440+0000","last_clean":"2024-09-12T02:05:23.127440+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:23.127440+0000","last_undegraded":"2024-09-12T02:05:23.127440+0000","last_fullsized":"2024-09-12T02:05:23.127440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50805,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":102,"num_read_kb":104,"num_write":152,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1076292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972379,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234016,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1029781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":485390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":484229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":47963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:05:33.918 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:05:33.919 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T02:05:33.919 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T02:05:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 -- 172.21.15.100:0/4016630544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 msgr2=0x7ffa240ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 --2- 172.21.15.100:0/4016630544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa240ffde0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009900 tx=0x7ffa1402a410 comp rx=0 tx=0).stop 2024-09-12T02:05:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 -- 172.21.15.100:0/4016630544 shutdown_connections 2024-09-12T02:05:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 --2- 172.21.15.100:0/4016630544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa241078e0 0x7ffa24109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 --2- 172.21.15.100:0/4016630544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa24100320 0x7ffa24107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 --2- 172.21.15.100:0/4016630544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa240ffde0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 -- 172.21.15.100:0/4016630544 >> 172.21.15.100:0/4016630544 conn(0x7ffa240fb610 msgr2=0x7ffa240fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 -- 172.21.15.100:0/4016630544 shutdown_connections 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.644+0000 7ffa28c27640 1 -- 172.21.15.100:0/4016630544 wait complete. 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 Processor -- start 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 -- start start 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa24197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa24100320 0x7ffa241984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa241078e0 0x7ffa2419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2410d920 con 0x7ffa240ff9e0 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2410d7a0 con 0x7ffa24100320 2024-09-12T02:05:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa28c27640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2410daa0 con 0x7ffa241078e0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa24197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa24197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57414/0 (socket says 172.21.15.100:57414) 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 -- 172.21.15.100:0/580395513 learned_addr learned my addr 172.21.15.100:0/580395513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 -- 172.21.15.100:0/580395513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa241078e0 msgr2=0x7ffa2419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa241078e0 0x7ffa2419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 -- 172.21.15.100:0/580395513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa24100320 msgr2=0x7ffa241984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa24100320 0x7ffa241984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.645+0000 7ffa2259c640 1 -- 172.21.15.100:0/580395513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2419fbb0 con 0x7ffa240ff9e0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.646+0000 7ffa2259c640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa24197f80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa14005ab0 tx=0x7ffa14004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.646+0000 7ffa137fe640 1 -- 172.21.15.100:0/580395513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1403f030 con 0x7ffa240ff9e0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.646+0000 7ffa137fe640 1 -- 172.21.15.100:0/580395513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa14003ce0 con 0x7ffa240ff9e0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.646+0000 7ffa137fe640 1 -- 172.21.15.100:0/580395513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14035070 con 0x7ffa240ff9e0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.646+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2419fe40 con 0x7ffa240ff9e0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.646+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa241a0370 con 0x7ffa240ff9e0 2024-09-12T02:05:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.647+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa24106160 con 0x7ffa240ff9e0 2024-09-12T02:05:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.648+0000 7ffa137fe640 1 -- 172.21.15.100:0/580395513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ffa14042030 con 0x7ffa240ff9e0 2024-09-12T02:05:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.648+0000 7ffa137fe640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ffa0c0a2cc0 0x7ffa0c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.648+0000 7ffa137fe640 1 -- 172.21.15.100:0/580395513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffa140ef880 con 0x7ffa240ff9e0 2024-09-12T02:05:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.648+0000 7ffa21d9b640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ffa0c0a2cc0 0x7ffa0c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.649+0000 7ffa21d9b640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ffa0c0a2cc0 0x7ffa0c0a5180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa241994a0 tx=0x7ffa18005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.653+0000 7ffa137fe640 1 -- 172.21.15.100:0/580395513 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa140bc690 con 0x7ffa240ff9e0 2024-09-12T02:05:34.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.882+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ffa2402d7c0 con 0x7ffa240ff9e0 2024-09-12T02:05:34.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.884+0000 7ffa137fe640 1 -- 172.21.15.100:0/580395513 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7ffa140bbf90 con 0x7ffa240ff9e0 2024-09-12T02:05:34.886 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-12T02:05:34.886 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBuTOJmUW+7NBAA1KSuRicFeG01IfymJmydiw== 2024-09-12T02:05:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ffa0c0a2cc0 msgr2=0x7ffa0c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ffa0c0a2cc0 0x7ffa0c0a5180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa241994a0 tx=0x7ffa18005bf0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 msgr2=0x7ffa24197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa24197f80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa14005ab0 tx=0x7ffa14004430 comp rx=0 tx=0).stop 2024-09-12T02:05:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 shutdown_connections 2024-09-12T02:05:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ffa0c0a2cc0 0x7ffa0c0a5180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa241078e0 0x7ffa2419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa24100320 0x7ffa241984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 --2- 172.21.15.100:0/580395513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa240ff9e0 0x7ffa24197f80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 >> 172.21.15.100:0/580395513 conn(0x7ffa240fb610 msgr2=0x7ffa24103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 shutdown_connections 2024-09-12T02:05:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:34.886+0000 7ffa28c27640 1 -- 172.21.15.100:0/580395513 wait complete. 2024-09-12T02:05:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:35 smithi117 ceph-mon[35240]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:35 smithi117 ceph-mon[35240]: pgmap v288: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s; 53 B/s, 0 objects/s recovering 2024-09-12T02:05:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:35 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/580395513' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:05:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:35 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/580395513' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:05:35.519 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:35 smithi100 ceph-mon[31179]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:35.520 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:35 smithi100 ceph-mon[31179]: pgmap v288: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s; 53 B/s, 0 objects/s recovering 2024-09-12T02:05:35.520 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:35 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/580395513' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:05:35.520 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:35 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/580395513' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:05:35.548 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:05:35.548 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T02:05:35.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:05:35.585 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:05:35.586 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:05:35.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T02:05:35.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:35 smithi189 ceph-mon[35188]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:35.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:35 smithi189 ceph-mon[35188]: pgmap v288: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s; 53 B/s, 0 objects/s recovering 2024-09-12T02:05:35.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:35 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/580395513' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:05:35.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:35 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/580395513' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:05:35.869 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 -- 172.21.15.100:0/937054009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 msgr2=0x7fa570101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 --2- 172.21.15.100:0/937054009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570101200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa560009900 tx=0x7fa56002a480 comp rx=0 tx=0).stop 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 -- 172.21.15.100:0/937054009 shutdown_connections 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 --2- 172.21.15.100:0/937054009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa570102ef0 0x7fa57010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 --2- 172.21.15.100:0/937054009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa570102570 0x7fa5701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 --2- 172.21.15.100:0/937054009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570101200 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 -- 172.21.15.100:0/937054009 >> 172.21.15.100:0/937054009 conn(0x7fa5700fc7d0 msgr2=0x7fa5700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 -- 172.21.15.100:0/937054009 shutdown_connections 2024-09-12T02:05:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 -- 172.21.15.100:0/937054009 wait complete. 2024-09-12T02:05:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 Processor -- start 2024-09-12T02:05:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 -- start start 2024-09-12T02:05:36.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa570102570 0x7fa570199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.296+0000 7fa576ea5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa570102ef0 0x7fa5701a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa576ea5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa570110fa0 con 0x7fa570100e20 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa576ea5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa570110e20 con 0x7fa570102570 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa576ea5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa570111120 con 0x7fa570102ef0 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57424/0 (socket says 172.21.15.100:57424) 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 -- 172.21.15.100:0/1827424044 learned_addr learned my addr 172.21.15.100:0/1827424044 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa575442640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa570102ef0 0x7fa5701a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa56ffff640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa570102570 0x7fa570199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 -- 172.21.15.100:0/1827424044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa570102ef0 msgr2=0x7fa5701a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa570102ef0 0x7fa5701a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 -- 172.21.15.100:0/1827424044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa570102570 msgr2=0x7fa570199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa570102570 0x7fa570199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 -- 172.21.15.100:0/1827424044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5701a48f0 con 0x7fa570100e20 2024-09-12T02:05:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa56ffff640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa570102570 0x7fa570199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa574c41640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570199330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa560006010 tx=0x7fa560003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa56dffb640 1 -- 172.21.15.100:0/1827424044 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56003f070 con 0x7fa570100e20 2024-09-12T02:05:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa56dffb640 1 -- 172.21.15.100:0/1827424044 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa560031e30 con 0x7fa570100e20 2024-09-12T02:05:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5701a4ac0 con 0x7fa570100e20 2024-09-12T02:05:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.297+0000 7fa56dffb640 1 -- 172.21.15.100:0/1827424044 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560035030 con 0x7fa570100e20 2024-09-12T02:05:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.298+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5701a4f70 con 0x7fa570100e20 2024-09-12T02:05:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.298+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa570101200 con 0x7fa570100e20 2024-09-12T02:05:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.299+0000 7fa56dffb640 1 -- 172.21.15.100:0/1827424044 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa560042070 con 0x7fa570100e20 2024-09-12T02:05:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.300+0000 7fa56dffb640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa5580a2c90 0x7fa5580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.300+0000 7fa56ffff640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa5580a2c90 0x7fa5580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.300+0000 7fa56dffb640 1 -- 172.21.15.100:0/1827424044 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa5600f0000 con 0x7fa570100e20 2024-09-12T02:05:36.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.301+0000 7fa56ffff640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa5580a2c90 0x7fa5580a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa57006aac0 tx=0x7fa564007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:36.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.303+0000 7fa56dffb640 1 -- 172.21.15.100:0/1827424044 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5600bcee0 con 0x7fa570100e20 2024-09-12T02:05:36.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.515+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa5701a5140 con 0x7fa570100e20 2024-09-12T02:05:36.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.519+0000 7fa56dffb640 1 -- 172.21.15.100:0/1827424044 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263209 (secure 0 0 0) 0x7fa5600bc7e0 con 0x7fa570100e20 2024-09-12T02:05:36.524 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa5580a2c90 msgr2=0x7fa5580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa5580a2c90 0x7fa5580a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa57006aac0 tx=0x7fa564007850 comp rx=0 tx=0).stop 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 msgr2=0x7fa570199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570199330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa560006010 tx=0x7fa560003c80 comp rx=0 tx=0).stop 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 shutdown_connections 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa5580a2c90 0x7fa5580a5150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa570102ef0 0x7fa5701a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa570102570 0x7fa570199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 --2- 172.21.15.100:0/1827424044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa570100e20 0x7fa570199330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.522+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 >> 172.21.15.100:0/1827424044 conn(0x7fa5700fc7d0 msgr2=0x7fa570106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.523+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 shutdown_connections 2024-09-12T02:05:36.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:36.523+0000 7fa576ea5640 1 -- 172.21.15.100:0/1827424044 wait complete. 2024-09-12T02:05:37.182 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":3532459665},{"type":"v1","addr":"172.21.15.100:6801","nonce":3532459665}]},"active_addr":"172.21.15.100:6801/3532459665","active_change":"2024-09-12T01:58:21.937389+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.100:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2993804054}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3119186302}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2222146367}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1350101913}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":245217397}]}]} 2024-09-12T02:05:37.188 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T02:05:37.188 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T02:05:37.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:05:37.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:37 smithi100 ceph-mon[31179]: pgmap v289: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T02:05:37.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:37 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1827424044' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:05:37.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:37 smithi117 ceph-mon[35240]: pgmap v289: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T02:05:37.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:37 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1827424044' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:05:37.434 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:37 smithi189 ceph-mon[35188]: pgmap v289: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T02:05:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:37 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1827424044' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:05:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 -- 172.21.15.100:0/2754657695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94100350 msgr2=0x7efe94100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 --2- 172.21.15.100:0/2754657695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94100350 0x7efe94100730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe84009930 tx=0x7efe8402a420 comp rx=0 tx=0).stop 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 -- 172.21.15.100:0/2754657695 shutdown_connections 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 --2- 172.21.15.100:0/2754657695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe94106f50 0x7efe9410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 --2- 172.21.15.100:0/2754657695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe94100d00 0x7efe94106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 --2- 172.21.15.100:0/2754657695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94100350 0x7efe94100730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 -- 172.21.15.100:0/2754657695 >> 172.21.15.100:0/2754657695 conn(0x7efe94077210 msgr2=0x7efe940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 -- 172.21.15.100:0/2754657695 shutdown_connections 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.871+0000 7efe9948f640 1 -- 172.21.15.100:0/2754657695 wait complete. 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 Processor -- start 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 -- start start 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe94100350 0x7efe94198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe94100d00 0x7efe94198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94106f50 0x7efe9419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efe94112000 con 0x7efe94106f50 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efe94111e80 con 0x7efe94100d00 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe9948f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efe94112180 con 0x7efe94100350 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.872+0000 7efe937fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94106f50 0x7efe9419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94106f50 0x7efe9419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57442/0 (socket says 172.21.15.100:57442) 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 -- 172.21.15.100:0/1789761714 learned_addr learned my addr 172.21.15.100:0/1789761714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe927fc640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe94100d00 0x7efe94198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe92ffd640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe94100350 0x7efe94198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 -- 172.21.15.100:0/1789761714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe94100350 msgr2=0x7efe94198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe94100350 0x7efe94198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 -- 172.21.15.100:0/1789761714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe94100d00 msgr2=0x7efe94198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe94100d00 0x7efe94198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 -- 172.21.15.100:0/1789761714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9419d4d0 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe937fe640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94106f50 0x7efe9419cdf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00b970 tx=0x7efe8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe7bfff640 1 -- 172.21.15.100:0/1789761714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c019070 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe7bfff640 1 -- 172.21.15.100:0/1789761714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe8c00cb40 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe7bfff640 1 -- 172.21.15.100:0/1789761714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c007650 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9419d7c0 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.873+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe941a50a0 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.874+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe94100730 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.875+0000 7efe7bfff640 1 -- 172.21.15.100:0/1789761714 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efe8c01c070 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.876+0000 7efe7bfff640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efe7c0a2c10 0x7efe7c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.876+0000 7efe92ffd640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efe7c0a2c10 0x7efe7c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.876+0000 7efe7bfff640 1 -- 172.21.15.100:0/1789761714 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efe8c0ce610 con 0x7efe94106f50 2024-09-12T02:05:37.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.876+0000 7efe92ffd640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efe7c0a2c10 0x7efe7c0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe84000c00 tx=0x7efe84005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:37.880+0000 7efe7bfff640 1 -- 172.21.15.100:0/1789761714 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe8c09aee0 con 0x7efe94106f50 2024-09-12T02:05:38.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.048+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe94109bb0 con 0x7efe94106f50 2024-09-12T02:05:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.050+0000 7efe7bfff640 1 -- 172.21.15.100:0/1789761714 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7efe8c09f1e0 con 0x7efe94106f50 2024-09-12T02:05:38.050 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:38.050 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:05:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efe7c0a2c10 msgr2=0x7efe7c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efe7c0a2c10 0x7efe7c0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe84000c00 tx=0x7efe84005a20 comp rx=0 tx=0).stop 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94106f50 msgr2=0x7efe9419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94106f50 0x7efe9419cdf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00b970 tx=0x7efe8c00be30 comp rx=0 tx=0).stop 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 shutdown_connections 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efe7c0a2c10 0x7efe7c0a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe94106f50 0x7efe9419cdf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe94100d00 0x7efe94198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 --2- 172.21.15.100:0/1789761714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe94100350 0x7efe94198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 >> 172.21.15.100:0/1789761714 conn(0x7efe94077210 msgr2=0x7efe940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 shutdown_connections 2024-09-12T02:05:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:38.052+0000 7efe9948f640 1 -- 172.21.15.100:0/1789761714 wait complete. 2024-09-12T02:05:38.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:38 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1789761714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:38.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:38 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1789761714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:38.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:38 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1789761714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:38.693 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T02:05:38.693 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:39.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:39 smithi100 ceph-mon[31179]: pgmap v290: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T02:05:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 -- 172.21.15.100:0/918565778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 msgr2=0x7f01ec106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 --2- 172.21.15.100:0/918565778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec106e60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009930 tx=0x7f01dc02a420 comp rx=0 tx=0).stop 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 -- 172.21.15.100:0/918565778 shutdown_connections 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 --2- 172.21.15.100:0/918565778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01ec101420 0x7f01ec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 --2- 172.21.15.100:0/918565778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01ec100a80 0x7f01ec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 --2- 172.21.15.100:0/918565778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec106e60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 -- 172.21.15.100:0/918565778 >> 172.21.15.100:0/918565778 conn(0x7f01ec0fc7a0 msgr2=0x7f01ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 -- 172.21.15.100:0/918565778 shutdown_connections 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.403+0000 7f01f292d640 1 -- 172.21.15.100:0/918565778 wait complete. 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 Processor -- start 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 -- start start 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01ec100a80 0x7f01ec199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01ec101420 0x7f01ec1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec1a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec110f20 con 0x7f01ec106a80 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec110da0 con 0x7f01ec100a80 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f292d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec1110a0 con 0x7f01ec101420 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec1a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec1a44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57454/0 (socket says 172.21.15.100:57454) 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 -- 172.21.15.100:0/1857562101 learned_addr learned my addr 172.21.15.100:0/1857562101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01ebfff640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01ec100a80 0x7f01ec199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 -- 172.21.15.100:0/1857562101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01ec101420 msgr2=0x7f01ec1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01ec101420 0x7f01ec1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 -- 172.21.15.100:0/1857562101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01ec100a80 msgr2=0x7f01ec199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01ec100a80 0x7f01ec199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 -- 172.21.15.100:0/1857562101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec1a4a20 con 0x7f01ec106a80 2024-09-12T02:05:39.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01ebfff640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01ec100a80 0x7f01ec199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.404+0000 7f01f0eca640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec1a44e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b970 tx=0x7f01e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.405+0000 7f01e9ffb640 1 -- 172.21.15.100:0/1857562101 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4019070 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.405+0000 7f01e9ffb640 1 -- 172.21.15.100:0/1857562101 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e400cb40 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.405+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec1a4bf0 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.405+0000 7f01e9ffb640 1 -- 172.21.15.100:0/1857562101 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4007650 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.405+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec1a5100 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.406+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ec100f60 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.407+0000 7f01e9ffb640 1 -- 172.21.15.100:0/1857562101 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f01e401c070 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.407+0000 7f01e9ffb640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f01d80a2c10 0x7f01d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.407+0000 7f01ebfff640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f01d80a2c10 0x7f01d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.407+0000 7f01e9ffb640 1 -- 172.21.15.100:0/1857562101 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f01e40ce6f0 con 0x7f01ec106a80 2024-09-12T02:05:39.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.408+0000 7f01ebfff640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f01d80a2c10 0x7f01d80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f01dc000c00 tx=0x7f01dc032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.411+0000 7f01e9ffb640 1 -- 172.21.15.100:0/1857562101 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01e409b610 con 0x7f01ec106a80 2024-09-12T02:05:39.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.578+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01ec06ad80 con 0x7f01ec106a80 2024-09-12T02:05:39.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.580+0000 7f01e9ffb640 1 -- 172.21.15.100:0/1857562101 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7f01e409af10 con 0x7f01ec106a80 2024-09-12T02:05:39.580 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:05:39.580 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f01d80a2c10 msgr2=0x7f01d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f01d80a2c10 0x7f01d80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f01dc000c00 tx=0x7f01dc032d50 comp rx=0 tx=0).stop 2024-09-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 msgr2=0x7f01ec1a44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec1a44e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b970 tx=0x7f01e400be30 comp rx=0 tx=0).stop 2024-09-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 shutdown_connections 2024-09-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f01d80a2c10 0x7f01d80a50d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01ec106a80 0x7f01ec1a44e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01ec101420 0x7f01ec1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 --2- 172.21.15.100:0/1857562101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01ec100a80 0x7f01ec199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 >> 172.21.15.100:0/1857562101 conn(0x7f01ec0fc7a0 msgr2=0x7f01ec0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 shutdown_connections 2024-09-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:39.582+0000 7f01f292d640 1 -- 172.21.15.100:0/1857562101 wait complete. 2024-09-12T02:05:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:39 smithi189 ceph-mon[35188]: pgmap v290: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T02:05:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:39 smithi117 ceph-mon[35240]: pgmap v290: 97 pgs: 97 active+clean; 634 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-09-12T02:05:40.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T02:05:40.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T02:05:40.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T02:05:40.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T02:05:40.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T02:05:40.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T02:05:40.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T02:05:40.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T02:05:40.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T02:05:40.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T02:05:40.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T02:05:40.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T02:05:40.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:40 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1857562101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:40 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1857562101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:40 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1857562101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:05:40.958 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:40.964 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:41.266 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:41 smithi100 ceph-mon[31179]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-12T02:05:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:41 smithi189 ceph-mon[35188]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-12T02:05:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:41 smithi117 ceph-mon[35240]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-12T02:05:41.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 -- 172.21.15.100:0/2546339050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0101420 msgr2=0x7f8cb010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:41.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 --2- 172.21.15.100:0/2546339050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0101420 0x7f8cb010d950 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009cd0 tx=0x7f8ca802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:05:41.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 -- 172.21.15.100:0/2546339050 shutdown_connections 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 --2- 172.21.15.100:0/2546339050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0101420 0x7f8cb010d950 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 --2- 172.21.15.100:0/2546339050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb0100a80 0x7f8cb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 --2- 172.21.15.100:0/2546339050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cb0106a80 0x7f8cb0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 -- 172.21.15.100:0/2546339050 >> 172.21.15.100:0/2546339050 conn(0x7f8cb00fc7a0 msgr2=0x7f8cb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 -- 172.21.15.100:0/2546339050 shutdown_connections 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 -- 172.21.15.100:0/2546339050 wait complete. 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.829+0000 7f8cb70b7640 1 Processor -- start 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb70b7640 1 -- start start 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb70b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cb0100a80 0x7f8cb01a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb70b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb0101420 0x7f8cb01a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb70b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0106a80 0x7f8cb019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb70b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0110f20 con 0x7f8cb0106a80 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb70b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0110da0 con 0x7f8cb0101420 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb70b7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb01110a0 con 0x7f8cb0100a80 2024-09-12T02:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0106a80 0x7f8cb019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0106a80 0x7f8cb019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57480/0 (socket says 172.21.15.100:57480) 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 -- 172.21.15.100:0/3730161073 learned_addr learned my addr 172.21.15.100:0/3730161073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb4e53640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cb0100a80 0x7f8cb01a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8caffff640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb0101420 0x7f8cb01a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 -- 172.21.15.100:0/3730161073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cb0100a80 msgr2=0x7f8cb01a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cb0100a80 0x7f8cb01a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 -- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb0101420 msgr2=0x7f8cb01a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb0101420 0x7f8cb01a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 -- 172.21.15.100:0/3730161073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb019acd0 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.830+0000 7f8cb5654640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0106a80 0x7f8cb019a5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8006010 tx=0x7f8ca8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.831+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8004450 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.831+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca8003e10 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.831+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb019af60 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.831+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8046480 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.831+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb01a72b0 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.832+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cb006b2b0 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.833+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8ca80045f0 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.833+0000 7f8cadffb640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ca00a2c10 0x7f8ca00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.833+0000 7f8cb4e53640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ca00a2c10 0x7f8ca00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.834+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8ca802e030 con 0x7f8cb0106a80 2024-09-12T02:05:41.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.834+0000 7f8cadffb640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] conn(0x7f8ca00ac7c0 0x7f8ca00aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.834+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 --> [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ca804fe50 con 0x7f8ca00ac7c0 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.834+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f8ca80f0f20 con 0x7f8cb0106a80 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.834+0000 7f8cb4e53640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ca00a2c10 0x7f8ca00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009990 tx=0x7f8ca4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.834+0000 7f8caffff640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] conn(0x7f8ca00ac7c0 0x7f8ca00aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.835+0000 7f8caffff640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] conn(0x7f8ca00ac7c0 0x7f8ca00aec60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.835+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== osd.4 v2:172.21.15.117:6808/855252072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ca804fe50 con 0x7f8ca00ac7c0 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.848+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 --> [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cb01021c0 con 0x7f8ca00ac7c0 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cadffb640 1 -- 172.21.15.100:0/3730161073 <== osd.4 v2:172.21.15.117:6808/855252072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8cb01021c0 con 0x7f8ca00ac7c0 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] conn(0x7f8ca00ac7c0 msgr2=0x7f8ca00aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] conn(0x7f8ca00ac7c0 0x7f8ca00aec60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ca00a2c10 msgr2=0x7f8ca00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8ca00a2c10 0x7f8ca00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009990 tx=0x7f8ca4009110 comp rx=0 tx=0).stop 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0106a80 msgr2=0x7f8cb019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:41.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 --2- 172.21.15.100:0/3730161073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb0106a80 0x7f8cb019a5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8006010 tx=0x7f8ca8003c20 comp rx=0 tx=0).stop 2024-09-12T02:05:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb5654640 1 -- 172.21.15.100:0/3730161073 reap_dead start 2024-09-12T02:05:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 shutdown_connections 2024-09-12T02:05:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.849+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 >> 172.21.15.100:0/3730161073 conn(0x7f8cb00fc7a0 msgr2=0x7f8cb006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.850+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 shutdown_connections 2024-09-12T02:05:41.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.850+0000 7f8cb70b7640 1 -- 172.21.15.100:0/3730161073 wait complete. 2024-09-12T02:05:42.069 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.069 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.073 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.073 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.078 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.576 INFO:teuthology.orchestra.run.smithi100.stdout:128849018935 2024-09-12T02:05:42.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T02:05:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:42 smithi100 ceph-mon[31179]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:05:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.725+0000 7fe097574640 1 -- 172.21.15.100:0/2098337987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 msgr2=0x7fe090103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.725+0000 7fe097574640 1 --2- 172.21.15.100:0/2098337987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 0x7fe090103110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe080009cd0 tx=0x7fe08002a910 comp rx=0 tx=0).stop 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.725+0000 7fe097574640 1 -- 172.21.15.100:0/2098337987 shutdown_connections 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.725+0000 7fe097574640 1 --2- 172.21.15.100:0/2098337987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0901082a0 0x7fe09010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.725+0000 7fe097574640 1 --2- 172.21.15.100:0/2098337987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0901036e0 0x7fe090107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.725+0000 7fe097574640 1 --2- 172.21.15.100:0/2098337987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 0x7fe090103110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.725+0000 7fe097574640 1 -- 172.21.15.100:0/2098337987 >> 172.21.15.100:0/2098337987 conn(0x7fe0900fc7d0 msgr2=0x7fe0900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 -- 172.21.15.100:0/2098337987 shutdown_connections 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 -- 172.21.15.100:0/2098337987 wait complete. 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 Processor -- start 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 -- start start 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 0x7fe0901986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0901036e0 0x7fe090198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0901082a0 0x7fe09019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe090112160 con 0x7fe090102d30 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe090111fe0 con 0x7fe0901082a0 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe097574640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901122e0 con 0x7fe0901036e0 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe095310640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 0x7fe0901986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe095310640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 0x7fe0901986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57460/0 (socket says 172.21.15.100:57460) 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.726+0000 7fe095310640 1 -- 172.21.15.100:0/3799331515 learned_addr learned my addr 172.21.15.100:0/3799331515 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe095310640 1 -- 172.21.15.100:0/3799331515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0901036e0 msgr2=0x7fe090198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe095310640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0901036e0 0x7fe090198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe095310640 1 -- 172.21.15.100:0/3799331515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0901082a0 msgr2=0x7fe09019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe095310640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0901082a0 0x7fe09019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe095310640 1 -- 172.21.15.100:0/3799331515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09019d690 con 0x7fe090102d30 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe095310640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 0x7fe0901986e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe0800098d0 tx=0x7fe080031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080031850 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe080004520 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09019d920 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08002fe20 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.727+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0901a5260 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.728+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe090062980 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.729+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe080004040 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe08e7fc640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe0780a2c10 0x7fe0780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe094b0f640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe0780a2c10 0x7fe0780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe0800f0a30 con 0x7fe090102d30 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe08e7fc640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] conn(0x7fe0780ac7c0 0x7fe0780aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 --> [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe08000b150 con 0x7fe0780ac7c0 2024-09-12T02:05:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe0800f0e80 con 0x7fe090102d30 2024-09-12T02:05:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe095b11640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] conn(0x7fe0780ac7c0 0x7fe0780aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe094b0f640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe0780a2c10 0x7fe0780a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0900feec0 tx=0x7fe084006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.730+0000 7fe095b11640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] conn(0x7fe0780ac7c0 0x7fe0780aec60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.731+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== osd.3 v2:172.21.15.100:6810/2982818857 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe08000b150 con 0x7fe0780ac7c0 2024-09-12T02:05:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.744+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 --> [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe090062e00 con 0x7fe0780ac7c0 2024-09-12T02:05:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe08e7fc640 1 -- 172.21.15.100:0/3799331515 <== osd.3 v2:172.21.15.100:6810/2982818857 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe090062e00 con 0x7fe0780ac7c0 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] conn(0x7fe0780ac7c0 msgr2=0x7fe0780aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] conn(0x7fe0780ac7c0 0x7fe0780aec60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe0780a2c10 msgr2=0x7fe0780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe0780a2c10 0x7fe0780a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0900feec0 tx=0x7fe084006c90 comp rx=0 tx=0).stop 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 msgr2=0x7fe0901986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 --2- 172.21.15.100:0/3799331515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe090102d30 0x7fe0901986e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe0800098d0 tx=0x7fe080031460 comp rx=0 tx=0).stop 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe095b11640 1 -- 172.21.15.100:0/3799331515 reap_dead start 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 shutdown_connections 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 >> 172.21.15.100:0/3799331515 conn(0x7fe0900fc7d0 msgr2=0x7fe090105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 shutdown_connections 2024-09-12T02:05:42.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:41.745+0000 7fe097574640 1 -- 172.21.15.100:0/3799331515 wait complete. 2024-09-12T02:05:43.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:42 smithi189 ceph-mon[35188]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:05:43.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:42 smithi117 ceph-mon[35240]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:05:43.160 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:43.901 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 -- 172.21.15.100:0/203792398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118100e20 msgr2=0x7f5118101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 --2- 172.21.15.100:0/203792398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118100e20 0x7f5118101200 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5108009900 tx=0x7f510802a480 comp rx=0 tx=0).stop 2024-09-12T02:05:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 -- 172.21.15.100:0/203792398 shutdown_connections 2024-09-12T02:05:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 --2- 172.21.15.100:0/203792398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118102ef0 0x7f511810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 --2- 172.21.15.100:0/203792398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5118102570 0x7f51181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 --2- 172.21.15.100:0/203792398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118100e20 0x7f5118101200 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 -- 172.21.15.100:0/203792398 >> 172.21.15.100:0/203792398 conn(0x7f51180fc7d0 msgr2=0x7f51180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 -- 172.21.15.100:0/203792398 shutdown_connections 2024-09-12T02:05:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.902+0000 7f511d19d640 1 -- 172.21.15.100:0/203792398 wait complete. 2024-09-12T02:05:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.903+0000 7f511d19d640 1 Processor -- start 2024-09-12T02:05:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.903+0000 7f511d19d640 1 -- start start 2024-09-12T02:05:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511d19d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5118100e20 0x7f511819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511d19d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118102570 0x7f511819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511d19d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118102ef0 0x7f511819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511d19d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5118110f80 con 0x7f5118102ef0 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511d19d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5118110e00 con 0x7f5118102570 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511d19d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5118111100 con 0x7f5118100e20 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118102ef0 0x7f511819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118102ef0 0x7f511819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43890/0 (socket says 172.21.15.100:43890) 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511759e640 1 -- 172.21.15.100:0/1565127437 learned_addr learned my addr 172.21.15.100:0/1565127437 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f5116d9d640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5118100e20 0x7f511819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511659c640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118102570 0x7f511819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511759e640 1 -- 172.21.15.100:0/1565127437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5118100e20 msgr2=0x7f511819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511759e640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5118100e20 0x7f511819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511759e640 1 -- 172.21.15.100:0/1565127437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118102570 msgr2=0x7f511819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.904+0000 7f511759e640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118102570 0x7f511819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f511759e640 1 -- 172.21.15.100:0/1565127437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511819f610 con 0x7f5118102ef0 2024-09-12T02:05:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f5116d9d640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5118100e20 0x7f511819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f511759e640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118102ef0 0x7f511819ef30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f511000cce0 tx=0x7f511000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511000f450 con 0x7f5118102ef0 2024-09-12T02:05:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f511000fad0 con 0x7f5118102ef0 2024-09-12T02:05:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511819f900 con 0x7f5118102ef0 2024-09-12T02:05:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110018c10 con 0x7f5118102ef0 2024-09-12T02:05:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.905+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51181a71e0 con 0x7f5118102ef0 2024-09-12T02:05:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.906+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f511806aa30 con 0x7f5118102ef0 2024-09-12T02:05:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.908+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f511000f5f0 con 0x7f5118102ef0 2024-09-12T02:05:43.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.908+0000 7f510ffff640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51040a2c90 0x7f51040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f5116d9d640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51040a2c90 0x7f51040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f51100cfad0 con 0x7f5118102ef0 2024-09-12T02:05:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f510ffff640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] conn(0x7f51040ac840 0x7f51040aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 --> [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f511001ee50 con 0x7f51040ac840 2024-09-12T02:05:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f51100cff20 con 0x7f5118102ef0 2024-09-12T02:05:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f511659c640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] conn(0x7f51040ac840 0x7f51040aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f5116d9d640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51040a2c90 0x7f51040a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5108005ab0 tx=0x7f5108005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:43.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.909+0000 7f511659c640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] conn(0x7f51040ac840 0x7f51040aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:43.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.910+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== osd.6 v2:172.21.15.100:6818/4036405723 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f511001ee50 con 0x7f51040ac840 2024-09-12T02:05:43.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.925+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 --> [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51181021b0 con 0x7f51040ac840 2024-09-12T02:05:43.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.925+0000 7f510ffff640 1 -- 172.21.15.100:0/1565127437 <== osd.6 v2:172.21.15.100:6818/4036405723 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f51181021b0 con 0x7f51040ac840 2024-09-12T02:05:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.925+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] conn(0x7f51040ac840 msgr2=0x7f51040aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.925+0000 7f511d19d640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] conn(0x7f51040ac840 0x7f51040aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51040a2c90 msgr2=0x7f51040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:43.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f51040a2c90 0x7f51040a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5108005ab0 tx=0x7f5108005a20 comp rx=0 tx=0).stop 2024-09-12T02:05:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118102ef0 msgr2=0x7f511819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 --2- 172.21.15.100:0/1565127437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5118102ef0 0x7f511819ef30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f511000cce0 tx=0x7f511000a620 comp rx=0 tx=0).stop 2024-09-12T02:05:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511759e640 1 -- 172.21.15.100:0/1565127437 reap_dead start 2024-09-12T02:05:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 shutdown_connections 2024-09-12T02:05:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 >> 172.21.15.100:0/1565127437 conn(0x7f51180fc7d0 msgr2=0x7f5118069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 shutdown_connections 2024-09-12T02:05:43.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:43.926+0000 7f511d19d640 1 -- 172.21.15.100:0/1565127437 wait complete. 2024-09-12T02:05:44.892 INFO:teuthology.orchestra.run.smithi100.stdout:180388626477 2024-09-12T02:05:44.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T02:05:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 -- 172.21.15.100:0/1504533263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388100e20 msgr2=0x7fb388101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 --2- 172.21.15.100:0/1504533263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388100e20 0x7fb388101200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb378009900 tx=0x7fb37802a480 comp rx=0 tx=0).stop 2024-09-12T02:05:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 -- 172.21.15.100:0/1504533263 shutdown_connections 2024-09-12T02:05:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 --2- 172.21.15.100:0/1504533263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb388102ef0 0x7fb38810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 --2- 172.21.15.100:0/1504533263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb388102570 0x7fb3881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 --2- 172.21.15.100:0/1504533263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388100e20 0x7fb388101200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 -- 172.21.15.100:0/1504533263 >> 172.21.15.100:0/1504533263 conn(0x7fb3880fc7d0 msgr2=0x7fb3880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 -- 172.21.15.100:0/1504533263 shutdown_connections 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.045+0000 7fb38ce74640 1 -- 172.21.15.100:0/1504533263 wait complete. 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 Processor -- start 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 -- start start 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb388100e20 0x7fb3881992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb388102570 0x7fb388199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388102ef0 0x7fb3881a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb388110f80 con 0x7fb388102ef0 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb388110e00 con 0x7fb388102570 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb38ce74640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb388111100 con 0x7fb388100e20 2024-09-12T02:05:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb386d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388102ef0 0x7fb3881a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb386d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388102ef0 0x7fb3881a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43902/0 (socket says 172.21.15.100:43902) 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.046+0000 7fb386d9d640 1 -- 172.21.15.100:0/3025005018 learned_addr learned my addr 172.21.15.100:0/3025005018 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb38659c640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb388100e20 0x7fb3881992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb385d9b640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb388102570 0x7fb388199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb386d9d640 1 -- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb388100e20 msgr2=0x7fb3881992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb386d9d640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb388100e20 0x7fb3881992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb386d9d640 1 -- 172.21.15.100:0/3025005018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb388102570 msgr2=0x7fb388199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb386d9d640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb388102570 0x7fb388199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb386d9d640 1 -- 172.21.15.100:0/3025005018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3881a48b0 con 0x7fb388102ef0 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb38659c640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb388100e20 0x7fb3881992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb386d9d640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388102ef0 0x7fb3881a4370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb38000cce0 tx=0x7fb38000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38000f450 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3881a4a80 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb38000fad0 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380018c10 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.047+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3881a4f90 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.048+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb388062980 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.049+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb38000f5f0 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.050+0000 7fb3777fe640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3700a2c10 0x7fb3700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.050+0000 7fb38659c640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3700a2c10 0x7fb3700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.050+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb3800cfb00 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.050+0000 7fb3777fe640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] conn(0x7fb3700ac7c0 0x7fb3700aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.050+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 --> [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3700af330 con 0x7fb3700ac7c0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.050+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb3800cff50 con 0x7fb388102ef0 2024-09-12T02:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.050+0000 7fb38659c640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3700a2c10 0x7fb3700a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb378005ab0 tx=0x7fb378005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.051+0000 7fb385d9b640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] conn(0x7fb3700ac7c0 0x7fb3700aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.051+0000 7fb385d9b640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] conn(0x7fb3700ac7c0 0x7fb3700aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.052+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== osd.2 v2:172.21.15.189:6800/1587987599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3700af330 con 0x7fb3700ac7c0 2024-09-12T02:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.066+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 --> [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb388062e00 con 0x7fb3700ac7c0 2024-09-12T02:05:45.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.066+0000 7fb3777fe640 1 -- 172.21.15.100:0/3025005018 <== osd.2 v2:172.21.15.189:6800/1587987599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb388062e00 con 0x7fb3700ac7c0 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.066+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] conn(0x7fb3700ac7c0 msgr2=0x7fb3700aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.066+0000 7fb38ce74640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] conn(0x7fb3700ac7c0 0x7fb3700aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3700a2c10 msgr2=0x7fb3700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3700a2c10 0x7fb3700a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb378005ab0 tx=0x7fb378005a20 comp rx=0 tx=0).stop 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388102ef0 msgr2=0x7fb3881a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 --2- 172.21.15.100:0/3025005018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388102ef0 0x7fb3881a4370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb38000cce0 tx=0x7fb38000a620 comp rx=0 tx=0).stop 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb386d9d640 1 -- 172.21.15.100:0/3025005018 reap_dead start 2024-09-12T02:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 shutdown_connections 2024-09-12T02:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 >> 172.21.15.100:0/3025005018 conn(0x7fb3880fc7d0 msgr2=0x7fb3880fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 shutdown_connections 2024-09-12T02:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.067+0000 7fb38ce74640 1 -- 172.21.15.100:0/3025005018 wait complete. 2024-09-12T02:05:45.165 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:45 smithi100 ceph-mon[31179]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-12T02:05:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- 172.21.15.100:0/1085490247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102ef0 msgr2=0x7fad8410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 --2- 172.21.15.100:0/1085490247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102ef0 0x7fad8410da40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009ca0 tx=0x7fad7c02a950 comp rx=0 tx=0).stop 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- 172.21.15.100:0/1085490247 shutdown_connections 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 --2- 172.21.15.100:0/1085490247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102ef0 0x7fad8410da40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 --2- 172.21.15.100:0/1085490247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad84102570 0x7fad841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 --2- 172.21.15.100:0/1085490247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad84100e20 0x7fad84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- 172.21.15.100:0/1085490247 >> 172.21.15.100:0/1085490247 conn(0x7fad840fc7d0 msgr2=0x7fad840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- 172.21.15.100:0/1085490247 shutdown_connections 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- 172.21.15.100:0/1085490247 wait complete. 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 Processor -- start 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- start start 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad84100e20 0x7fad84198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102570 0x7fad841989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad84102ef0 0x7fad8419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad84110f80 con 0x7fad84102570 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad84110e00 con 0x7fad84100e20 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.249+0000 7fad8a782640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad84111100 con 0x7fad84102ef0 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102570 0x7fad841989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102570 0x7fad841989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43918/0 (socket says 172.21.15.100:43918) 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 -- 172.21.15.100:0/2819196261 learned_addr learned my addr 172.21.15.100:0/2819196261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad83fff640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad84100e20 0x7fad84198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad88d1f640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad84102ef0 0x7fad8419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 -- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad84102ef0 msgr2=0x7fad8419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad84102ef0 0x7fad8419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 -- 172.21.15.100:0/2819196261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad84100e20 msgr2=0x7fad84198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad84100e20 0x7fad84198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 -- 172.21.15.100:0/2819196261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8419d440 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad88d1f640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad84102ef0 0x7fad8419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad83fff640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad84100e20 0x7fad84198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad7bfff640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102570 0x7fad841989d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00c970 tx=0x7fad6c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c007bb0 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad6c007d50 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8419d730 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00f450 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.250+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad841a5010 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.251+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad84104210 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.253+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fad6c004fe0 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.253+0000 7fad81ffb640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fad700a2c10 0x7fad700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.253+0000 7fad83fff640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fad700a2c10 0x7fad700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.253+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fad6c0cf430 con 0x7fad84102570 2024-09-12T02:05:45.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.254+0000 7fad81ffb640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] conn(0x7fad700ac7c0 0x7fad700aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.254+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 --> [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad700af330 con 0x7fad700ac7c0 2024-09-12T02:05:45.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.254+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fad6c0cf880 con 0x7fad84102570 2024-09-12T02:05:45.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.254+0000 7fad83fff640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fad700a2c10 0x7fad700a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad740058c0 tx=0x7fad74005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.254+0000 7fad88d1f640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] conn(0x7fad700ac7c0 0x7fad700aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.255+0000 7fad88d1f640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] conn(0x7fad700ac7c0 0x7fad700aec60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.255+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== osd.5 v2:172.21.15.189:6808/3192404099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad700af330 con 0x7fad700ac7c0 2024-09-12T02:05:45.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.284+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 --> [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad841021b0 con 0x7fad700ac7c0 2024-09-12T02:05:45.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.285+0000 7fad81ffb640 1 -- 172.21.15.100:0/2819196261 <== osd.5 v2:172.21.15.189:6808/3192404099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad841021b0 con 0x7fad700ac7c0 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.285+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] conn(0x7fad700ac7c0 msgr2=0x7fad700aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.285+0000 7fad8a782640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] conn(0x7fad700ac7c0 0x7fad700aec60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.285+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fad700a2c10 msgr2=0x7fad700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.285+0000 7fad8a782640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fad700a2c10 0x7fad700a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad740058c0 tx=0x7fad74005ec0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.285+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102570 msgr2=0x7fad841989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.286+0000 7fad8a782640 1 --2- 172.21.15.100:0/2819196261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad84102570 0x7fad841989d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00c970 tx=0x7fad6c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.286+0000 7fad88d1f640 1 -- 172.21.15.100:0/2819196261 reap_dead start 2024-09-12T02:05:45.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.286+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 shutdown_connections 2024-09-12T02:05:45.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.286+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 >> 172.21.15.100:0/2819196261 conn(0x7fad840fc7d0 msgr2=0x7fad841037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.286+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 shutdown_connections 2024-09-12T02:05:45.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.286+0000 7fad8a782640 1 -- 172.21.15.100:0/2819196261 wait complete. 2024-09-12T02:05:45.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:45 smithi189 ceph-mon[35188]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-12T02:05:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:45 smithi117 ceph-mon[35240]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-12T02:05:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 -- 172.21.15.100:0/464058112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102570 msgr2=0x7f970c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 --2- 172.21.15.100:0/464058112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102570 0x7f970c1029b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009900 tx=0x7f96f802a480 comp rx=0 tx=0).stop 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 -- 172.21.15.100:0/464058112 shutdown_connections 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 --2- 172.21.15.100:0/464058112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970c102ef0 0x7f970c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 --2- 172.21.15.100:0/464058112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102570 0x7f970c1029b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 --2- 172.21.15.100:0/464058112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f970c100e20 0x7f970c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 -- 172.21.15.100:0/464058112 >> 172.21.15.100:0/464058112 conn(0x7f970c0fc7d0 msgr2=0x7f970c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 -- 172.21.15.100:0/464058112 shutdown_connections 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.481+0000 7f9712ee8640 1 -- 172.21.15.100:0/464058112 wait complete. 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 Processor -- start 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 -- start start 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f970c100e20 0x7f970c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970c102570 0x7f970c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102ef0 0x7f970c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f970c110f80 con 0x7f970c102ef0 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f970c110e00 con 0x7f970c102570 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9712ee8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f970c111100 con 0x7f970c100e20 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9711485640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102ef0 0x7f970c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9711485640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102ef0 0x7f970c19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43926/0 (socket says 172.21.15.100:43926) 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9711485640 1 -- 172.21.15.100:0/2913829238 learned_addr learned my addr 172.21.15.100:0/2913829238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f970bfff640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970c102570 0x7f970c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9710c84640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f970c100e20 0x7f970c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9711485640 1 -- 172.21.15.100:0/2913829238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f970c100e20 msgr2=0x7f970c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.482+0000 7f9711485640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f970c100e20 0x7f970c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9711485640 1 -- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970c102570 msgr2=0x7f970c19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9711485640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970c102570 0x7f970c19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9711485640 1 -- 172.21.15.100:0/2913829238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c19f6c0 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9711485640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102ef0 0x7f970c19efe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f970400cce0 tx=0x7f970400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970400f450 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c19f9b0 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970400fad0 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704018c10 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.483+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c1a7290 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.484+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f970c10d0b0 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.485+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f970400f5f0 con 0x7f970c102ef0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f9709ffb640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f96fc0a2c10 0x7f96fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f9710c84640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f96fc0a2c10 0x7f96fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f97040cf7f0 con 0x7f970c102ef0 2024-09-12T02:05:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f9709ffb640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] conn(0x7f96fc0ac7c0 0x7f96fc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 --> [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9704015e70 con 0x7f96fc0ac7c0 2024-09-12T02:05:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f97040d42c0 con 0x7f970c102ef0 2024-09-12T02:05:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f9710c84640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f96fc0a2c10 0x7f96fc0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9700005fd0 tx=0x7f9700005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.486+0000 7f970bfff640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] conn(0x7f96fc0ac7c0 0x7f96fc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.487+0000 7f970bfff640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] conn(0x7f96fc0ac7c0 0x7f96fc0aec60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:45.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.488+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== osd.7 v2:172.21.15.117:6816/3443138169 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9704015e70 con 0x7f96fc0ac7c0 2024-09-12T02:05:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.503+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 --> [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f970c1021b0 con 0x7f96fc0ac7c0 2024-09-12T02:05:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.503+0000 7f9709ffb640 1 -- 172.21.15.100:0/2913829238 <== osd.7 v2:172.21.15.117:6816/3443138169 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f970c1021b0 con 0x7f96fc0ac7c0 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] conn(0x7f96fc0ac7c0 msgr2=0x7f96fc0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] conn(0x7f96fc0ac7c0 0x7f96fc0aec60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f96fc0a2c10 msgr2=0x7f96fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f96fc0a2c10 0x7f96fc0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9700005fd0 tx=0x7f9700005850 comp rx=0 tx=0).stop 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102ef0 msgr2=0x7f970c19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 --2- 172.21.15.100:0/2913829238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f970c102ef0 0x7f970c19efe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f970400cce0 tx=0x7f970400a620 comp rx=0 tx=0).stop 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9711485640 1 -- 172.21.15.100:0/2913829238 reap_dead start 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 shutdown_connections 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 >> 172.21.15.100:0/2913829238 conn(0x7f970c0fc7d0 msgr2=0x7f970c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 shutdown_connections 2024-09-12T02:05:45.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:45.504+0000 7f9712ee8640 1 -- 172.21.15.100:0/2913829238 wait complete. 2024-09-12T02:05:47.140 INFO:teuthology.orchestra.run.smithi100.stdout:201863462952 2024-09-12T02:05:47.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T02:05:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:47 smithi189 ceph-mon[35188]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:05:47.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:47 smithi117 ceph-mon[35240]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:05:47.443 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:47 smithi100 ceph-mon[31179]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:05:47.517 INFO:teuthology.orchestra.run.smithi100.stdout:73014444097 2024-09-12T02:05:47.517 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T02:05:47.872 INFO:teuthology.orchestra.run.smithi100.stdout:98784247867 2024-09-12T02:05:47.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T02:05:48.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 -- 172.21.15.100:0/43980809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0102790 msgr2=0x7ff0d01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 --2- 172.21.15.100:0/43980809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0102790 0x7ff0d01067e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009900 tx=0x7ff0c002a410 comp rx=0 tx=0).stop 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 -- 172.21.15.100:0/43980809 shutdown_connections 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 --2- 172.21.15.100:0/43980809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d0106f10 0x7ff0d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 --2- 172.21.15.100:0/43980809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0102790 0x7ff0d01067e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 --2- 172.21.15.100:0/43980809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d0101de0 0x7ff0d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 -- 172.21.15.100:0/43980809 >> 172.21.15.100:0/43980809 conn(0x7ff0d00fd8c0 msgr2=0x7ff0d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 -- 172.21.15.100:0/43980809 shutdown_connections 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.512+0000 7ff0d76a0640 1 -- 172.21.15.100:0/43980809 wait complete. 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 Processor -- start 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 -- start start 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d0101de0 0x7ff0d01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d0102790 0x7ff0d0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0106f10 0x7ff0d019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d0112010 con 0x7ff0d0106f10 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d0111e90 con 0x7ff0d0101de0 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d76a0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d0112190 con 0x7ff0d0102790 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0106f10 0x7ff0d019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0106f10 0x7ff0d019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43972/0 (socket says 172.21.15.100:43972) 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 -- 172.21.15.100:0/1190554879 learned_addr learned my addr 172.21.15.100:0/1190554879 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d543c640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d0101de0 0x7ff0d01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d4c3b640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d0102790 0x7ff0d0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 -- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d0102790 msgr2=0x7ff0d0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d0102790 0x7ff0d0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 -- 172.21.15.100:0/1190554879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d0101de0 msgr2=0x7ff0d01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d0101de0 0x7ff0d01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d5c3d640 1 -- 172.21.15.100:0/1190554879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d019d560 con 0x7ff0d0106f10 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d4c3b640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d0102790 0x7ff0d0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.513+0000 7ff0d543c640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d0101de0 0x7ff0d01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.514+0000 7ff0d5c3d640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0106f10 0x7ff0d019ce80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800b970 tx=0x7ff0c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.514+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8019070 con 0x7ff0d0106f10 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.514+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0c800cb40 con 0x7ff0d0106f10 2024-09-12T02:05:48.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.514+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d019d850 con 0x7ff0d0106f10 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.514+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8007650 con 0x7ff0d0106f10 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.514+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d01a5130 con 0x7ff0d0106f10 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.515+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0d0062980 con 0x7ff0d0106f10 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.516+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff0c801c070 con 0x7ff0d0106f10 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0c67fc640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff0bc0a2c10 0x7ff0bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0d543c640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff0bc0a2c10 0x7ff0bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff0c80ce750 con 0x7ff0d0106f10 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0c67fc640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] conn(0x7ff0bc0ac7c0 0x7ff0bc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 --> [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0c8017e70 con 0x7ff0bc0ac7c0 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7ff0c80d5050 con 0x7ff0d0106f10 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0d543c640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff0bc0a2c10 0x7ff0bc0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009930 tx=0x7ff0cc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.517+0000 7ff0d4c3b640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] conn(0x7ff0bc0ac7c0 0x7ff0bc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:48.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.518+0000 7ff0d4c3b640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] conn(0x7ff0bc0ac7c0 0x7ff0bc0aec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.519+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== osd.11 v2:172.21.15.189:6824/3473203367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0c8017e70 con 0x7ff0bc0ac7c0 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.532+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 --> [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0d0062e00 con 0x7ff0bc0ac7c0 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.532+0000 7ff0c67fc640 1 -- 172.21.15.100:0/1190554879 <== osd.11 v2:172.21.15.189:6824/3473203367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff0d0062e00 con 0x7ff0bc0ac7c0 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] conn(0x7ff0bc0ac7c0 msgr2=0x7ff0bc0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] conn(0x7ff0bc0ac7c0 0x7ff0bc0aec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff0bc0a2c10 msgr2=0x7ff0bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff0bc0a2c10 0x7ff0bc0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009930 tx=0x7ff0cc008040 comp rx=0 tx=0).stop 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0106f10 msgr2=0x7ff0d019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 --2- 172.21.15.100:0/1190554879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0d0106f10 0x7ff0d019ce80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800b970 tx=0x7ff0c800be30 comp rx=0 tx=0).stop 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d5c3d640 1 -- 172.21.15.100:0/1190554879 reap_dead start 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 shutdown_connections 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 >> 172.21.15.100:0/1190554879 conn(0x7ff0d00fd8c0 msgr2=0x7ff0d00fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:48.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 shutdown_connections 2024-09-12T02:05:48.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:48.533+0000 7ff0d76a0640 1 -- 172.21.15.100:0/1190554879 wait complete. 2024-09-12T02:05:49.106 INFO:teuthology.orchestra.run.smithi100.stdout:317827579924 2024-09-12T02:05:49.106 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T02:05:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 -- 172.21.15.100:0/535443606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 msgr2=0x7f6a241031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 --2- 172.21.15.100:0/535443606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 0x7f6a241031b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009930 tx=0x7f6a1802a420 comp rx=0 tx=0).stop 2024-09-12T02:05:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 -- 172.21.15.100:0/535443606 shutdown_connections 2024-09-12T02:05:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 --2- 172.21.15.100:0/535443606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a24108300 0x7f6a2410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 --2- 172.21.15.100:0/535443606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a24103780 0x7f6a24107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 --2- 172.21.15.100:0/535443606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 0x7f6a241031b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 -- 172.21.15.100:0/535443606 >> 172.21.15.100:0/535443606 conn(0x7f6a240fc7d0 msgr2=0x7f6a240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 -- 172.21.15.100:0/535443606 shutdown_connections 2024-09-12T02:05:49.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.274+0000 7f6a2af53640 1 -- 172.21.15.100:0/535443606 wait complete. 2024-09-12T02:05:49.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 Processor -- start 2024-09-12T02:05:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 -- start start 2024-09-12T02:05:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 0x7f6a24100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a24103780 0x7f6a24100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a24108300 0x7f6a241014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241120b0 con 0x7f6a24102dd0 2024-09-12T02:05:49.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24111f30 con 0x7f6a24103780 2024-09-12T02:05:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a2af53640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24112230 con 0x7f6a24108300 2024-09-12T02:05:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 0x7f6a24100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 0x7f6a24100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43994/0 (socket says 172.21.15.100:43994) 2024-09-12T02:05:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 -- 172.21.15.100:0/3448925827 learned_addr learned my addr 172.21.15.100:0/3448925827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a23fff640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a24103780 0x7f6a24100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a294f0640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a24108300 0x7f6a241014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 -- 172.21.15.100:0/3448925827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a24108300 msgr2=0x7f6a241014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a24108300 0x7f6a241014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 -- 172.21.15.100:0/3448925827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a24103780 msgr2=0x7f6a24100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a24103780 0x7f6a24100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a28cef640 1 -- 172.21.15.100:0/3448925827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a241a6ab0 con 0x7f6a24102dd0 2024-09-12T02:05:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.275+0000 7f6a23fff640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a24103780 0x7f6a24100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:49.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.276+0000 7f6a28cef640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 0x7f6a24100a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009230 tx=0x7f6a18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.276+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1803f030 con 0x7f6a24102dd0 2024-09-12T02:05:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.276+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a241a6d40 con 0x7f6a24102dd0 2024-09-12T02:05:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.276+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a18003ad0 con 0x7f6a24102dd0 2024-09-12T02:05:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.276+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a18035070 con 0x7f6a24102dd0 2024-09-12T02:05:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.276+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a241a7210 con 0x7f6a24102dd0 2024-09-12T02:05:49.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.277+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a24062880 con 0x7f6a24102dd0 2024-09-12T02:05:49.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.278+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6a18042030 con 0x7f6a24102dd0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.279+0000 7f6a21ffb640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a140a2c10 0x7f6a140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.279+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6a180efba0 con 0x7f6a24102dd0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.279+0000 7f6a23fff640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a140a2c10 0x7f6a140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.279+0000 7f6a21ffb640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] conn(0x7f6a140ac7c0 0x7f6a140aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.279+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 --> [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a18045e50 con 0x7f6a140ac7c0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.279+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f6a180efff0 con 0x7f6a24102dd0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.279+0000 7f6a294f0640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] conn(0x7f6a140ac7c0 0x7f6a140aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.280+0000 7f6a23fff640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a140a2c10 0x7f6a140a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a100058c0 tx=0x7f6a10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.280+0000 7f6a294f0640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] conn(0x7f6a140ac7c0 0x7f6a140aec60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.280+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== osd.0 v2:172.21.15.100:6802/590713730 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a18045e50 con 0x7f6a140ac7c0 2024-09-12T02:05:49.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.294+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 --> [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a24062cb0 con 0x7f6a140ac7c0 2024-09-12T02:05:49.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a21ffb640 1 -- 172.21.15.100:0/3448925827 <== osd.0 v2:172.21.15.100:6802/590713730 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6a24062cb0 con 0x7f6a140ac7c0 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] conn(0x7f6a140ac7c0 msgr2=0x7f6a140aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] conn(0x7f6a140ac7c0 0x7f6a140aec60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a140a2c10 msgr2=0x7f6a140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a140a2c10 0x7f6a140a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a100058c0 tx=0x7f6a10005850 comp rx=0 tx=0).stop 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 msgr2=0x7f6a24100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 --2- 172.21.15.100:0/3448925827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a24102dd0 0x7f6a24100a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009230 tx=0x7f6a18004270 comp rx=0 tx=0).stop 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a294f0640 1 -- 172.21.15.100:0/3448925827 reap_dead start 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 shutdown_connections 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 >> 172.21.15.100:0/3448925827 conn(0x7f6a240fc7d0 msgr2=0x7f6a24105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 shutdown_connections 2024-09-12T02:05:49.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.295+0000 7f6a2af53640 1 -- 172.21.15.100:0/3448925827 wait complete. 2024-09-12T02:05:49.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:49 smithi189 ceph-mon[35188]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:05:49.357 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:49 smithi100 ceph-mon[31179]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:05:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:49 smithi117 ceph-mon[35240]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:05:49.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 -- 172.21.15.100:0/2318454715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 msgr2=0x7f196010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 --2- 172.21.15.100:0/2318454715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 0x7f196010bb50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1954009900 tx=0x7f195402a480 comp rx=0 tx=0).stop 2024-09-12T02:05:49.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 -- 172.21.15.100:0/2318454715 shutdown_connections 2024-09-12T02:05:49.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 --2- 172.21.15.100:0/2318454715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196010c170 0x7f196010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 --2- 172.21.15.100:0/2318454715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 0x7f196010bb50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 --2- 172.21.15.100:0/2318454715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1960102d40 0x7f1960103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 -- 172.21.15.100:0/2318454715 >> 172.21.15.100:0/2318454715 conn(0x7f19600fc7a0 msgr2=0x7f19600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 -- 172.21.15.100:0/2318454715 shutdown_connections 2024-09-12T02:05:49.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.765+0000 7f1965991640 1 -- 172.21.15.100:0/2318454715 wait complete. 2024-09-12T02:05:49.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 Processor -- start 2024-09-12T02:05:49.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 -- start start 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1960102d40 0x7f1960198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 0x7f1960198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196010c170 0x7f196019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1960111fb0 con 0x7f1960103660 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1960111e30 con 0x7f196010c170 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f1965991640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1960112130 con 0x7f1960102d40 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f195e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 0x7f1960198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f195e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 0x7f1960198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44014/0 (socket says 172.21.15.100:44014) 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f195e7fc640 1 -- 172.21.15.100:0/3410395387 learned_addr learned my addr 172.21.15.100:0/3410395387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.766+0000 7f195effd640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1960102d40 0x7f1960198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f195f7fe640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196010c170 0x7f196019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f195e7fc640 1 -- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1960102d40 msgr2=0x7f1960198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f195e7fc640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1960102d40 0x7f1960198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f195e7fc640 1 -- 172.21.15.100:0/3410395387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196010c170 msgr2=0x7f196019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f195e7fc640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196010c170 0x7f196019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f195e7fc640 1 -- 172.21.15.100:0/3410395387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196019d540 con 0x7f1960103660 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f195e7fc640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 0x7f1960198ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1954005ab0 tx=0x7f19540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195403f030 con 0x7f1960103660 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1954003ce0 con 0x7f1960103660 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196019d7d0 con 0x7f1960103660 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954035070 con 0x7f1960103660 2024-09-12T02:05:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.767+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19601a5110 con 0x7f1960103660 2024-09-12T02:05:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.768+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1960062900 con 0x7f1960103660 2024-09-12T02:05:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.769+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1954042030 con 0x7f1960103660 2024-09-12T02:05:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.770+0000 7f196498f640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f19480a2c10 0x7f19480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.770+0000 7f195effd640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f19480a2c10 0x7f19480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.770+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19540efc80 con 0x7f1960103660 2024-09-12T02:05:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.770+0000 7f196498f640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] conn(0x7f19480ac7c0 0x7f19480aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.770+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 --> [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1954001d30 con 0x7f19480ac7c0 2024-09-12T02:05:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.770+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f19540f00d0 con 0x7f1960103660 2024-09-12T02:05:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.771+0000 7f195effd640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f19480a2c10 0x7f19480a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19500058c0 tx=0x7f195000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.771+0000 7f195f7fe640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] conn(0x7f19480ac7c0 0x7f19480aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.771+0000 7f195f7fe640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] conn(0x7f19480ac7c0 0x7f19480aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.772+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== osd.8 v2:172.21.15.189:6816/1310528835 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1954001d30 con 0x7f19480ac7c0 2024-09-12T02:05:49.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.785+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 --> [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1960062d00 con 0x7f19480ac7c0 2024-09-12T02:05:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.786+0000 7f196498f640 1 -- 172.21.15.100:0/3410395387 <== osd.8 v2:172.21.15.189:6816/1310528835 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1960062d00 con 0x7f19480ac7c0 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] conn(0x7f19480ac7c0 msgr2=0x7f19480aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] conn(0x7f19480ac7c0 0x7f19480aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f19480a2c10 msgr2=0x7f19480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f19480a2c10 0x7f19480a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19500058c0 tx=0x7f195000a2d0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 msgr2=0x7f1960198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 --2- 172.21.15.100:0/3410395387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1960103660 0x7f1960198ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1954005ab0 tx=0x7f19540042f0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f195f7fe640 1 -- 172.21.15.100:0/3410395387 reap_dead start 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 shutdown_connections 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 >> 172.21.15.100:0/3410395387 conn(0x7f19600fc7a0 msgr2=0x7f19600fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 shutdown_connections 2024-09-12T02:05:49.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.787+0000 7f1965991640 1 -- 172.21.15.100:0/3410395387 wait complete. 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 -- 172.21.15.100:0/2529594083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102570 msgr2=0x7fde941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 --2- 172.21.15.100:0/2529594083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102570 0x7fde941029b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009900 tx=0x7fde7c02a480 comp rx=0 tx=0).stop 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 -- 172.21.15.100:0/2529594083 shutdown_connections 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 --2- 172.21.15.100:0/2529594083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde94102ef0 0x7fde9410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 --2- 172.21.15.100:0/2529594083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102570 0x7fde941029b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 --2- 172.21.15.100:0/2529594083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde94100e20 0x7fde94101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 -- 172.21.15.100:0/2529594083 >> 172.21.15.100:0/2529594083 conn(0x7fde940fc7d0 msgr2=0x7fde940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 -- 172.21.15.100:0/2529594083 shutdown_connections 2024-09-12T02:05:49.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 -- 172.21.15.100:0/2529594083 wait complete. 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.522+0000 7fde9a025640 1 Processor -- start 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde9a025640 1 -- start start 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde9a025640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde94100e20 0x7fde941984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde9a025640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde94102570 0x7fde94198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde9a025640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102ef0 0x7fde9419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde9a025640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fde94110f80 con 0x7fde94102ef0 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde9a025640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fde94110e00 con 0x7fde94100e20 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde9a025640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde94111100 con 0x7fde94102570 2024-09-12T02:05:49.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102ef0 0x7fde9419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102ef0 0x7fde9419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43948/0 (socket says 172.21.15.100:43948) 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 -- 172.21.15.100:0/2969048476 learned_addr learned my addr 172.21.15.100:0/2969048476 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde92ffd640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde94102570 0x7fde94198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde937fe640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde94100e20 0x7fde941984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 -- 172.21.15.100:0/2969048476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde94102570 msgr2=0x7fde94198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde94102570 0x7fde94198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 -- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde94100e20 msgr2=0x7fde941984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde94100e20 0x7fde941984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde93fff640 1 -- 172.21.15.100:0/2969048476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9419d480 con 0x7fde94102ef0 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde92ffd640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde94102570 0x7fde94198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.523+0000 7fde937fe640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde94100e20 0x7fde941984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:49.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.524+0000 7fde93fff640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102ef0 0x7fde9419cda0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00eaa0 tx=0x7fde8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.524+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00cdb0 con 0x7fde94102ef0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.524+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde8c005020 con 0x7fde94102ef0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.524+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9419d770 con 0x7fde94102ef0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.524+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0116b0 con 0x7fde94102ef0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.524+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde941a5050 con 0x7fde94102ef0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.525+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde94062980 con 0x7fde94102ef0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.526+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fde8c005560 con 0x7fde94102ef0 2024-09-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde90ff9640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fde800a2c10 0x7fde800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde937fe640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fde800a2c10 0x7fde800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fde8c0cf8b0 con 0x7fde94102ef0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde90ff9640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] conn(0x7fde800ac7c0 0x7fde800aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 --> [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde8c014ec0 con 0x7fde800ac7c0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fde8c0cfd00 con 0x7fde94102ef0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde937fe640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fde800a2c10 0x7fde800a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fde84009b40 tx=0x7fde84005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.527+0000 7fde92ffd640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] conn(0x7fde800ac7c0 0x7fde800aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.528+0000 7fde92ffd640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] conn(0x7fde800ac7c0 0x7fde800aec60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.528+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== osd.10 v2:172.21.15.117:6824/1542358432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde8c014ec0 con 0x7fde800ac7c0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.542+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 --> [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde94062e00 con 0x7fde800ac7c0 2024-09-12T02:05:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.542+0000 7fde90ff9640 1 -- 172.21.15.100:0/2969048476 <== osd.10 v2:172.21.15.117:6824/1542358432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fde94062e00 con 0x7fde800ac7c0 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] conn(0x7fde800ac7c0 msgr2=0x7fde800aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] conn(0x7fde800ac7c0 0x7fde800aec60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fde800a2c10 msgr2=0x7fde800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fde800a2c10 0x7fde800a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fde84009b40 tx=0x7fde84005e50 comp rx=0 tx=0).stop 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102ef0 msgr2=0x7fde9419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 --2- 172.21.15.100:0/2969048476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde94102ef0 0x7fde9419cda0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00eaa0 tx=0x7fde8c00ef60 comp rx=0 tx=0).stop 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde93fff640 1 -- 172.21.15.100:0/2969048476 reap_dead start 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 shutdown_connections 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 >> 172.21.15.100:0/2969048476 conn(0x7fde940fc7d0 msgr2=0x7fde9406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 shutdown_connections 2024-09-12T02:05:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:46.543+0000 7fde9a025640 1 -- 172.21.15.100:0/2969048476 wait complete. 2024-09-12T02:05:50.573 INFO:teuthology.orchestra.run.smithi100.stdout:287762808857 2024-09-12T02:05:50.573 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T02:05:50.975 INFO:teuthology.orchestra.run.smithi100.stdout:34359738443 2024-09-12T02:05:50.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T02:05:51.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2317338236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24101de0 msgr2=0x7fdd241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:51.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 --2- 172.21.15.100:0/2317338236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24101de0 0x7fdd241021c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd18009900 tx=0x7fdd1802a410 comp rx=0 tx=0).stop 2024-09-12T02:05:51.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2317338236 shutdown_connections 2024-09-12T02:05:51.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 --2- 172.21.15.100:0/2317338236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd24106f10 0x7fdd2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:51.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 --2- 172.21.15.100:0/2317338236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd24102790 0x7fdd241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 --2- 172.21.15.100:0/2317338236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24101de0 0x7fdd241021c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2317338236 >> 172.21.15.100:0/2317338236 conn(0x7fdd240fd8c0 msgr2=0x7fdd240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2317338236 shutdown_connections 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.437+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2317338236 wait complete. 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 Processor -- start 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 -- start start 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd24101de0 0x7fdd240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24102790 0x7fdd24074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd24106f10 0x7fdd24074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24111fb0 con 0x7fdd24102790 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24111e30 con 0x7fdd24101de0 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd2ad74640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24112130 con 0x7fdd24106f10 2024-09-12T02:05:51.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24102790 0x7fdd24074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:51.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24102790 0x7fdd24074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44008/0 (socket says 172.21.15.100:44008) 2024-09-12T02:05:51.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 -- 172.21.15.100:0/2033035672 learned_addr learned my addr 172.21.15.100:0/2033035672 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:51.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd29311640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd24106f10 0x7fdd24074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:51.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd28b10640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd24101de0 0x7fdd240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:51.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 -- 172.21.15.100:0/2033035672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd24106f10 msgr2=0x7fdd24074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:51.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd24106f10 0x7fdd24074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 -- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd24101de0 msgr2=0x7fdd240744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd24101de0 0x7fdd240744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.438+0000 7fdd23fff640 1 -- 172.21.15.100:0/2033035672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd241a69a0 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.439+0000 7fdd23fff640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24102790 0x7fdd24074a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000b4a0 tx=0x7fdd1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.439+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10014070 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.439+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd10010af0 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.439+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd241a6c90 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.439+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10017d10 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.439+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd241a71c0 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.440+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd24062880 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.441+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fdd10017070 con 0x7fdd24102790 2024-09-12T02:05:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd21ffb640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdd140a2c90 0x7fdd140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd28b10640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdd140a2c90 0x7fdd140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdd100ce7b0 con 0x7fdd24102790 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd21ffb640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] conn(0x7fdd140ac840 0x7fdd140aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 --> [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd1000dec0 con 0x7fdd140ac840 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fdd100cec00 con 0x7fdd24102790 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd28b10640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdd140a2c90 0x7fdd140a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd180096c0 tx=0x7fdd18031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.442+0000 7fdd29311640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] conn(0x7fdd140ac840 0x7fdd140aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.443+0000 7fdd29311640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] conn(0x7fdd140ac840 0x7fdd140aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.444+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== osd.1 v2:172.21.15.117:6800/2755635305 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd1000dec0 con 0x7fdd140ac840 2024-09-12T02:05:51.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.457+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 --> [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd24062c80 con 0x7fdd140ac840 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd21ffb640 1 -- 172.21.15.100:0/2033035672 <== osd.1 v2:172.21.15.117:6800/2755635305 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdd24062c80 con 0x7fdd140ac840 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] conn(0x7fdd140ac840 msgr2=0x7fdd140aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] conn(0x7fdd140ac840 0x7fdd140aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdd140a2c90 msgr2=0x7fdd140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdd140a2c90 0x7fdd140a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd180096c0 tx=0x7fdd18031490 comp rx=0 tx=0).stop 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24102790 msgr2=0x7fdd24074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 --2- 172.21.15.100:0/2033035672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd24102790 0x7fdd24074a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000b4a0 tx=0x7fdd1000b960 comp rx=0 tx=0).stop 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd29311640 1 -- 172.21.15.100:0/2033035672 reap_dead start 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 shutdown_connections 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 >> 172.21.15.100:0/2033035672 conn(0x7fdd240fd8c0 msgr2=0x7fdd240fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 shutdown_connections 2024-09-12T02:05:51.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:49.458+0000 7fdd2ad74640 1 -- 172.21.15.100:0/2033035672 wait complete. 2024-09-12T02:05:51.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:51 smithi100 ceph-mon[31179]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T02:05:51.410 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:51 smithi117 ceph-mon[35240]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T02:05:51.411 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:51 smithi189 ceph-mon[35188]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T02:05:51.829 INFO:teuthology.orchestra.run.smithi100.stdout:150323855410 2024-09-12T02:05:51.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T02:05:52.433 INFO:teuthology.orchestra.run.smithi100.stdout:231928234021 2024-09-12T02:05:52.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T02:05:53.022 INFO:teuthology.orchestra.run.smithi100.stdout:55834574919 2024-09-12T02:05:53.022 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T02:05:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 -- 172.21.15.100:0/3298008688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601036e0 msgr2=0x7f4160107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 --2- 172.21.15.100:0/3298008688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601036e0 0x7f4160107b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4154009930 tx=0x7f415402a420 comp rx=0 tx=0).stop 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 -- 172.21.15.100:0/3298008688 shutdown_connections 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 --2- 172.21.15.100:0/3298008688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41601082a0 0x7f416010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 --2- 172.21.15.100:0/3298008688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601036e0 0x7f4160107b90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 --2- 172.21.15.100:0/3298008688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4160102d30 0x7f4160103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 -- 172.21.15.100:0/3298008688 >> 172.21.15.100:0/3298008688 conn(0x7f41600fc7d0 msgr2=0x7f41600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 -- 172.21.15.100:0/3298008688 shutdown_connections 2024-09-12T02:05:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.194+0000 7f4165350640 1 -- 172.21.15.100:0/3298008688 wait complete. 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 Processor -- start 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 -- start start 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4160102d30 0x7f4160198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41601036e0 0x7f4160198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601082a0 0x7f416019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4160112190 con 0x7f41601082a0 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4160112010 con 0x7f41601036e0 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.195+0000 7f4165350640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4160112310 con 0x7f4160102d30 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601082a0 0x7f416019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601082a0 0x7f416019d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44034/0 (socket says 172.21.15.100:44034) 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 -- 172.21.15.100:0/4218042257 learned_addr learned my addr 172.21.15.100:0/4218042257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415effd640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4160102d30 0x7f4160198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415e7fc640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41601036e0 0x7f4160198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 -- 172.21.15.100:0/4218042257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4160102d30 msgr2=0x7f4160198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4160102d30 0x7f4160198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 -- 172.21.15.100:0/4218042257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41601036e0 msgr2=0x7f4160198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41601036e0 0x7f4160198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 -- 172.21.15.100:0/4218042257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416019d700 con 0x7f41601082a0 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f415f7fe640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601082a0 0x7f416019d020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f415800b970 tx=0x7f415800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158019070 con 0x7f41601082a0 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416019d9f0 con 0x7f41601082a0 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4158014440 con 0x7f41601082a0 2024-09-12T02:05:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41580075d0 con 0x7f41601082a0 2024-09-12T02:05:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.196+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41601a52d0 con 0x7f41601082a0 2024-09-12T02:05:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.197+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4160062940 con 0x7f41601082a0 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.199+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f415801c070 con 0x7f41601082a0 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.199+0000 7f4147fff640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f41480a2c10 0x7f41480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f41580cee20 con 0x7f41601082a0 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f415effd640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f41480a2c10 0x7f41480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f4147fff640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] conn(0x7f41480ac7c0 0x7f41480aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 --> [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41480af330 con 0x7f41480ac7c0 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f41580cf270 con 0x7f41601082a0 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f415e7fc640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] conn(0x7f41480ac7c0 0x7f41480aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f415effd640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f41480a2c10 0x7f41480a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4150009990 tx=0x7f4150009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.200+0000 7f415e7fc640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] conn(0x7f41480ac7c0 0x7f41480aec60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.201+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== osd.9 v2:172.21.15.100:6826/2410385779 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41480af330 con 0x7f41480ac7c0 2024-09-12T02:05:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 --> [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4160062dc0 con 0x7f41480ac7c0 2024-09-12T02:05:53.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4147fff640 1 -- 172.21.15.100:0/4218042257 <== osd.9 v2:172.21.15.100:6826/2410385779 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4160062dc0 con 0x7f41480ac7c0 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] conn(0x7f41480ac7c0 msgr2=0x7f41480aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4165350640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] conn(0x7f41480ac7c0 0x7f41480aec60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f41480a2c10 msgr2=0x7f41480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4165350640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f41480a2c10 0x7f41480a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4150009990 tx=0x7f4150009110 comp rx=0 tx=0).stop 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601082a0 msgr2=0x7f416019d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.216+0000 7f4165350640 1 --2- 172.21.15.100:0/4218042257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41601082a0 0x7f416019d020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f415800b970 tx=0x7f415800bd70 comp rx=0 tx=0).stop 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.217+0000 7f415f7fe640 1 -- 172.21.15.100:0/4218042257 reap_dead start 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.217+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 shutdown_connections 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.217+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 >> 172.21.15.100:0/4218042257 conn(0x7f41600fc7d0 msgr2=0x7f4160105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.217+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 shutdown_connections 2024-09-12T02:05:53.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:53.217+0000 7f4165350640 1 -- 172.21.15.100:0/4218042257 wait complete. 2024-09-12T02:05:53.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:53 smithi100 ceph-mon[31179]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T02:05:53.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:53 smithi189 ceph-mon[35188]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T02:05:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:53 smithi117 ceph-mon[35240]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T02:05:53.470 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:54.324 INFO:teuthology.orchestra.run.smithi100.stdout:266287972384 2024-09-12T02:05:54.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T02:05:54.577 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:54.580 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:54.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 -- 172.21.15.100:0/596287271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4101410 msgr2=0x7f75a410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 --2- 172.21.15.100:0/596287271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4101410 0x7f75a410d940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f759c009cd0 tx=0x7f759c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 -- 172.21.15.100:0/596287271 shutdown_connections 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 --2- 172.21.15.100:0/596287271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4101410 0x7f75a410d940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 --2- 172.21.15.100:0/596287271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a4100a70 0x7f75a4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 --2- 172.21.15.100:0/596287271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75a4106a70 0x7f75a4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 -- 172.21.15.100:0/596287271 >> 172.21.15.100:0/596287271 conn(0x7f75a40fc790 msgr2=0x7f75a40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 -- 172.21.15.100:0/596287271 shutdown_connections 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.771+0000 7f75aa321640 1 -- 172.21.15.100:0/596287271 wait complete. 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 Processor -- start 2024-09-12T02:05:54.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 -- start start 2024-09-12T02:05:54.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a4100a70 0x7f75a41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:54.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75a4101410 0x7f75a4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:54.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4106a70 0x7f75a419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:54.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4110f10 con 0x7f75a4106a70 2024-09-12T02:05:54.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4110d90 con 0x7f75a4100a70 2024-09-12T02:05:54.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75aa321640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4111090 con 0x7f75a4101410 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4106a70 0x7f75a419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4106a70 0x7f75a419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59582/0 (socket says 172.21.15.100:59582) 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 -- 172.21.15.100:0/29080053 learned_addr learned my addr 172.21.15.100:0/29080053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a3fff640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a4100a70 0x7f75a41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a37fe640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75a4101410 0x7f75a4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 -- 172.21.15.100:0/29080053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75a4101410 msgr2=0x7f75a4198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75a4101410 0x7f75a4198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 -- 172.21.15.100:0/29080053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a4100a70 msgr2=0x7f75a41985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a4100a70 0x7f75a41985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a88be640 1 -- 172.21.15.100:0/29080053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a419d580 con 0x7f75a4106a70 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a37fe640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75a4101410 0x7f75a4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.772+0000 7f75a3fff640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a4100a70 0x7f75a41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:54.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.773+0000 7f75a88be640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4106a70 0x7f75a419cea0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f759c006010 tx=0x7f759c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:54.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.773+0000 7f75a17fa640 1 -- 172.21.15.100:0/29080053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c004450 con 0x7f75a4106a70 2024-09-12T02:05:54.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.773+0000 7f75a17fa640 1 -- 172.21.15.100:0/29080053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f759c003e10 con 0x7f75a4106a70 2024-09-12T02:05:54.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.773+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a419d810 con 0x7f75a4106a70 2024-09-12T02:05:54.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.773+0000 7f75a17fa640 1 -- 172.21.15.100:0/29080053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c0466e0 con 0x7f75a4106a70 2024-09-12T02:05:54.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.773+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a41a5150 con 0x7f75a4106a70 2024-09-12T02:05:54.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.774+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a4100f50 con 0x7f75a4106a70 2024-09-12T02:05:54.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.775+0000 7f75a17fa640 1 -- 172.21.15.100:0/29080053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f759c0305a0 con 0x7f75a4106a70 2024-09-12T02:05:54.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.776+0000 7f75a17fa640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f758c0a2c90 0x7f758c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:54.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.776+0000 7f75a3fff640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f758c0a2c90 0x7f758c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:54.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.776+0000 7f75a17fa640 1 -- 172.21.15.100:0/29080053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f759c02e030 con 0x7f75a4106a70 2024-09-12T02:05:54.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.776+0000 7f75a3fff640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f758c0a2c90 0x7f758c0a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7594009930 tx=0x7f7594008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:54.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.780+0000 7f75a17fa640 1 -- 172.21.15.100:0/29080053 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f759c04b060 con 0x7f75a4106a70 2024-09-12T02:05:54.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.958+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f75a4109a80 con 0x7f75a4106a70 2024-09-12T02:05:54.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.958+0000 7f75a17fa640 1 -- 172.21.15.100:0/29080053 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f759c0bd9c0 con 0x7f75a4106a70 2024-09-12T02:05:54.958 INFO:teuthology.orchestra.run.smithi100.stdout:180388626479 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f758c0a2c90 msgr2=0x7f758c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f758c0a2c90 0x7f758c0a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7594009930 tx=0x7f7594008040 comp rx=0 tx=0).stop 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4106a70 msgr2=0x7f75a419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4106a70 0x7f75a419cea0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f759c006010 tx=0x7f759c003c20 comp rx=0 tx=0).stop 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 shutdown_connections 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f758c0a2c90 0x7f758c0a5150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75a4106a70 0x7f75a419cea0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75a4101410 0x7f75a4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 --2- 172.21.15.100:0/29080053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a4100a70 0x7f75a41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:54.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 >> 172.21.15.100:0/29080053 conn(0x7f75a40fc790 msgr2=0x7f75a406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:54.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 shutdown_connections 2024-09-12T02:05:54.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:54.960+0000 7f75aa321640 1 -- 172.21.15.100:0/29080053 wait complete. 2024-09-12T02:05:55.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:55 smithi100 ceph-mon[31179]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:05:55.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:55 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/29080053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:05:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:55 smithi189 ceph-mon[35188]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:05:55.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:55 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/29080053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:05:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:55 smithi117 ceph-mon[35240]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:05:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:55 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/29080053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:05:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:55.612 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:55.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626477 got 180388626479 for osd.6 2024-09-12T02:05:55.754 DEBUG:teuthology.parallel:result is None 2024-09-12T02:05:55.945 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:55.945 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:56.258 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:56.259 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:56.260 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 -- 172.21.15.100:0/28548681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 msgr2=0x7fa6f0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 --2- 172.21.15.100:0/28548681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f0100ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009930 tx=0x7fa6e002a420 comp rx=0 tx=0).stop 2024-09-12T02:05:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 -- 172.21.15.100:0/28548681 shutdown_connections 2024-09-12T02:05:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 --2- 172.21.15.100:0/28548681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f0101420 0x7fa6f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 --2- 172.21.15.100:0/28548681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f0100ee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 --2- 172.21.15.100:0/28548681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6f0106a80 0x7fa6f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 -- 172.21.15.100:0/28548681 >> 172.21.15.100:0/28548681 conn(0x7fa6f00fc7a0 msgr2=0x7fa6f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 -- 172.21.15.100:0/28548681 shutdown_connections 2024-09-12T02:05:56.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.291+0000 7fa6f781e640 1 -- 172.21.15.100:0/28548681 wait complete. 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.292+0000 7fa6f781e640 1 Processor -- start 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.292+0000 7fa6f781e640 1 -- start start 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.292+0000 7fa6f781e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.292+0000 7fa6f781e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f0101420 0x7fa6f019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.292+0000 7fa6f781e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6f0106a80 0x7fa6f019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.292+0000 7fa6f781e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f0110e40 con 0x7fa6f0100a80 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.292+0000 7fa6f781e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f0110cc0 con 0x7fa6f0101420 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f781e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f0110fc0 con 0x7fa6f0106a80 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59610/0 (socket says 172.21.15.100:59610) 2024-09-12T02:05:56.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 -- 172.21.15.100:0/3279683444 learned_addr learned my addr 172.21.15.100:0/3279683444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f4db9640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f0101420 0x7fa6f019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f5dbb640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6f0106a80 0x7fa6f019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 -- 172.21.15.100:0/3279683444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6f0106a80 msgr2=0x7fa6f019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6f0106a80 0x7fa6f019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 -- 172.21.15.100:0/3279683444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f0101420 msgr2=0x7fa6f019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f0101420 0x7fa6f019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 -- 172.21.15.100:0/3279683444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f019f470 con 0x7fa6f0100a80 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f55ba640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f019a4c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00d950 tx=0x7fa6ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6e67fc640 1 -- 172.21.15.100:0/3279683444 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec017030 con 0x7fa6f0100a80 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6e67fc640 1 -- 172.21.15.100:0/3279683444 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec004020 con 0x7fa6f0100a80 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f019f760 con 0x7fa6f0100a80 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6e67fc640 1 -- 172.21.15.100:0/3279683444 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0047a0 con 0x7fa6f0100a80 2024-09-12T02:05:56.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.293+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f01a7040 con 0x7fa6f0100a80 2024-09-12T02:05:56.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.295+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f019b820 con 0x7fa6f0100a80 2024-09-12T02:05:56.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.296+0000 7fa6e67fc640 1 -- 172.21.15.100:0/3279683444 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa6ec0041d0 con 0x7fa6f0100a80 2024-09-12T02:05:56.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.296+0000 7fa6e67fc640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6dc0a2c90 0x7fa6dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.296+0000 7fa6f4db9640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6dc0a2c90 0x7fa6dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.297+0000 7fa6e67fc640 1 -- 172.21.15.100:0/3279683444 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa6ec0ce9d0 con 0x7fa6f0100a80 2024-09-12T02:05:56.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.297+0000 7fa6f4db9640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6dc0a2c90 0x7fa6dc0a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00ff240 tx=0x7fa6e000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:56.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.301+0000 7fa6e67fc640 1 -- 172.21.15.100:0/3279683444 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6ec09b7e0 con 0x7fa6f0100a80 2024-09-12T02:05:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.471+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa6f01a7490 con 0x7fa6f0100a80 2024-09-12T02:05:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.471+0000 7fa6e67fc640 1 -- 172.21.15.100:0/3279683444 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa6ec09b0e0 con 0x7fa6f0100a80 2024-09-12T02:05:56.472 INFO:teuthology.orchestra.run.smithi100.stdout:73014444099 2024-09-12T02:05:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6dc0a2c90 msgr2=0x7fa6dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6dc0a2c90 0x7fa6dc0a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00ff240 tx=0x7fa6e000b040 comp rx=0 tx=0).stop 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 msgr2=0x7fa6f019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f019a4c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00d950 tx=0x7fa6ec00de10 comp rx=0 tx=0).stop 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 shutdown_connections 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa6dc0a2c90 0x7fa6dc0a5150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6f0106a80 0x7fa6f019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f0101420 0x7fa6f019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 --2- 172.21.15.100:0/3279683444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f0100a80 0x7fa6f019a4c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 >> 172.21.15.100:0/3279683444 conn(0x7fa6f00fc7a0 msgr2=0x7fa6f006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 shutdown_connections 2024-09-12T02:05:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.473+0000 7fa6f781e640 1 -- 172.21.15.100:0/3279683444 wait complete. 2024-09-12T02:05:56.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 -- 172.21.15.100:0/1683695460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4106f10 msgr2=0x7f16f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 --2- 172.21.15.100:0/1683695460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4106f10 0x7f16f410ea90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009ca0 tx=0x7f16ec02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 -- 172.21.15.100:0/1683695460 shutdown_connections 2024-09-12T02:05:56.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 --2- 172.21.15.100:0/1683695460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4106f10 0x7f16f410ea90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 --2- 172.21.15.100:0/1683695460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16f4102790 0x7f16f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 --2- 172.21.15.100:0/1683695460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f4101de0 0x7f16f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 -- 172.21.15.100:0/1683695460 >> 172.21.15.100:0/1683695460 conn(0x7f16f40fd8c0 msgr2=0x7f16f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 -- 172.21.15.100:0/1683695460 shutdown_connections 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 -- 172.21.15.100:0/1683695460 wait complete. 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.530+0000 7f16f96d2640 1 Processor -- start 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f96d2640 1 -- start start 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f96d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f4101de0 0x7f16f4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f96d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4102790 0x7f16f4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f96d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16f4106f10 0x7f16f419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f96d2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4111f70 con 0x7f16f4102790 2024-09-12T02:05:56.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f96d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4111df0 con 0x7f16f4101de0 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f96d2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41120f0 con 0x7f16f4106f10 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4102790 0x7f16f4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4102790 0x7f16f4198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59620/0 (socket says 172.21.15.100:59620) 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 -- 172.21.15.100:0/472352205 learned_addr learned my addr 172.21.15.100:0/472352205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f2ffd640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f4101de0 0x7f16f4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f37fe640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16f4106f10 0x7f16f419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 -- 172.21.15.100:0/472352205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16f4106f10 msgr2=0x7f16f419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16f4106f10 0x7f16f419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 -- 172.21.15.100:0/472352205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f4101de0 msgr2=0x7f16f4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f4101de0 0x7f16f4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 -- 172.21.15.100:0/472352205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f419d3e0 con 0x7f16f4102790 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f37fe640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16f4106f10 0x7f16f419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:05:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16f2ffd640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f4101de0 0x7f16f4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.531+0000 7f16ea7fc640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4102790 0x7f16f4198970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c970 tx=0x7f16dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.532+0000 7f16f0ff9640 1 -- 172.21.15.100:0/472352205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc007bb0 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.532+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f419d6d0 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.532+0000 7f16f0ff9640 1 -- 172.21.15.100:0/472352205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16dc007d50 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.532+0000 7f16f0ff9640 1 -- 172.21.15.100:0/472352205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00f450 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.532+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f4074420 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.533+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f41021c0 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.534+0000 7f16f0ff9640 1 -- 172.21.15.100:0/472352205 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f16dc004fe0 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.534+0000 7f16f0ff9640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16e00a70a0 0x7f16e00a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.535+0000 7f16f2ffd640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16e00a70a0 0x7f16e00a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.535+0000 7f16f0ff9640 1 -- 172.21.15.100:0/472352205 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f16dc0cf340 con 0x7f16f4102790 2024-09-12T02:05:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.535+0000 7f16f2ffd640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16e00a70a0 0x7f16e00a9560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16e400abe0 tx=0x7f16e400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.538+0000 7f16f0ff9640 1 -- 172.21.15.100:0/472352205 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16dc014030 con 0x7f16f4102790 2024-09-12T02:05:56.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.714+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f16f4199790 con 0x7f16f4102790 2024-09-12T02:05:56.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.715+0000 7f16f0ff9640 1 -- 172.21.15.100:0/472352205 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f16dc09c1d0 con 0x7f16f4102790 2024-09-12T02:05:56.715 INFO:teuthology.orchestra.run.smithi100.stdout:201863462954 2024-09-12T02:05:56.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16e00a70a0 msgr2=0x7f16e00a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16e00a70a0 0x7f16e00a9560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16e400abe0 tx=0x7f16e400a5c0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4102790 msgr2=0x7f16f4198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:56.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4102790 0x7f16f4198970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c970 tx=0x7f16dc00ce30 comp rx=0 tx=0).stop 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 shutdown_connections 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16e00a70a0 0x7f16e00a9560 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16f4106f10 0x7f16f419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4102790 0x7f16f4198970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 --2- 172.21.15.100:0/472352205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f4101de0 0x7f16f4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 >> 172.21.15.100:0/472352205 conn(0x7f16f40fd8c0 msgr2=0x7f16f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 shutdown_connections 2024-09-12T02:05:56.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:56.717+0000 7f16f96d2640 1 -- 172.21.15.100:0/472352205 wait complete. 2024-09-12T02:05:57.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:57 smithi100 ceph-mon[31179]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:05:57.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:57 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3279683444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:05:57.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:57 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/472352205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:05:57.355 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444097 got 73014444099 for osd.2 2024-09-12T02:05:57.356 DEBUG:teuthology.parallel:result is None 2024-09-12T02:05:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:57 smithi117 ceph-mon[35240]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:05:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:57 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3279683444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:05:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:57 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/472352205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:05:57.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:57 smithi189 ceph-mon[35188]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:05:57.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:57 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3279683444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:05:57.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:57 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/472352205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:05:57.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462952 got 201863462954 for osd.7 2024-09-12T02:05:57.961 DEBUG:teuthology.parallel:result is None 2024-09-12T02:05:58.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 -- 172.21.15.100:0/2854257063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38101de0 msgr2=0x7fcf381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 --2- 172.21.15.100:0/2854257063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38101de0 0x7fcf381021c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009ca0 tx=0x7fcf2802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 -- 172.21.15.100:0/2854257063 shutdown_connections 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 --2- 172.21.15.100:0/2854257063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf38106f10 0x7fcf3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 --2- 172.21.15.100:0/2854257063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf38102790 0x7fcf381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 --2- 172.21.15.100:0/2854257063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38101de0 0x7fcf381021c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 -- 172.21.15.100:0/2854257063 >> 172.21.15.100:0/2854257063 conn(0x7fcf380fd8c0 msgr2=0x7fcf380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 -- 172.21.15.100:0/2854257063 shutdown_connections 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.225+0000 7fcf3d598640 1 -- 172.21.15.100:0/2854257063 wait complete. 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 Processor -- start 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 -- start start 2024-09-12T02:05:58.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf38101de0 0x7fcf381984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38102790 0x7fcf381989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf38106f10 0x7fcf3819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38111f90 con 0x7fcf38102790 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38111e10 con 0x7fcf38106f10 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.226+0000 7fcf3d598640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38112110 con 0x7fcf38101de0 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38102790 0x7fcf381989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38102790 0x7fcf381989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59640/0 (socket says 172.21.15.100:59640) 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 -- 172.21.15.100:0/867380910 learned_addr learned my addr 172.21.15.100:0/867380910 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf377fe640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf38106f10 0x7fcf3819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf36ffd640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf38101de0 0x7fcf381984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 -- 172.21.15.100:0/867380910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf38101de0 msgr2=0x7fcf381984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf38101de0 0x7fcf381984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 -- 172.21.15.100:0/867380910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf38106f10 msgr2=0x7fcf3819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf38106f10 0x7fcf3819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 -- 172.21.15.100:0/867380910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3819d460 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf367fc640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38102790 0x7fcf381989f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00d950 tx=0x7fcf2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf1ffff640 1 -- 172.21.15.100:0/867380910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c017070 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3819d750 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf1ffff640 1 -- 172.21.15.100:0/867380910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf2c009c30 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf1ffff640 1 -- 172.21.15.100:0/867380910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00f6b0 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.227+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf381a5030 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.228+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf381021c0 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.230+0000 7fcf1ffff640 1 -- 172.21.15.100:0/867380910 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcf2c0109d0 con 0x7fcf38102790 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.230+0000 7fcf1ffff640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcf200a2c10 0x7fcf200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.230+0000 7fcf36ffd640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcf200a2c10 0x7fcf200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.230+0000 7fcf1ffff640 1 -- 172.21.15.100:0/867380910 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcf2c0ced50 con 0x7fcf38102790 2024-09-12T02:05:58.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.231+0000 7fcf36ffd640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcf200a2c10 0x7fcf200a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf28006010 tx=0x7fcf28009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:58.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.234+0000 7fcf1ffff640 1 -- 172.21.15.100:0/867380910 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf2c009de0 con 0x7fcf38102790 2024-09-12T02:05:58.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.404+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fcf38199810 con 0x7fcf38102790 2024-09-12T02:05:58.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.404+0000 7fcf1ffff640 1 -- 172.21.15.100:0/867380910 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcf38199810 con 0x7fcf38102790 2024-09-12T02:05:58.404 INFO:teuthology.orchestra.run.smithi100.stdout:287762808859 2024-09-12T02:05:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcf200a2c10 msgr2=0x7fcf200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcf200a2c10 0x7fcf200a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf28006010 tx=0x7fcf28009360 comp rx=0 tx=0).stop 2024-09-12T02:05:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38102790 msgr2=0x7fcf381989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38102790 0x7fcf381989f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00d950 tx=0x7fcf2c00de10 comp rx=0 tx=0).stop 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 shutdown_connections 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcf200a2c10 0x7fcf200a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf38106f10 0x7fcf3819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf38102790 0x7fcf381989f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 --2- 172.21.15.100:0/867380910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf38101de0 0x7fcf381984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.406+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 >> 172.21.15.100:0/867380910 conn(0x7fcf380fd8c0 msgr2=0x7fcf380fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.407+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 shutdown_connections 2024-09-12T02:05:58.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:58.407+0000 7fcf3d598640 1 -- 172.21.15.100:0/867380910 wait complete. 2024-09-12T02:05:59.060 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808857 got 287762808859 for osd.10 2024-09-12T02:05:59.060 DEBUG:teuthology.parallel:result is None 2024-09-12T02:05:59.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 -- 172.21.15.100:0/2484444457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c10e4e0 msgr2=0x7f9f2c1108d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 --2- 172.21.15.100:0/2484444457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c10e4e0 0x7f9f2c1108d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009ca0 tx=0x7f9f2402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 -- 172.21.15.100:0/2484444457 shutdown_connections 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 --2- 172.21.15.100:0/2484444457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c10e4e0 0x7f9f2c1108d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 --2- 172.21.15.100:0/2484444457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c1012e0 0x7f9f2c10dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 --2- 172.21.15.100:0/2484444457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f2c100930 0x7f9f2c100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 -- 172.21.15.100:0/2484444457 >> 172.21.15.100:0/2484444457 conn(0x7f9f2c0fc7a0 msgr2=0x7f9f2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 -- 172.21.15.100:0/2484444457 shutdown_connections 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 -- 172.21.15.100:0/2484444457 wait complete. 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.257+0000 7f9f315ee640 1 Processor -- start 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 -- start start 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c100930 0x7f9f2c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c1012e0 0x7f9f2c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f2c10e4e0 0x7f9f2c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c114160 con 0x7f9f2c1012e0 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c113fe0 con 0x7f9f2c100930 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1142e0 con 0x7f9f2c10e4e0 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c1012e0 0x7f9f2c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c1012e0 0x7f9f2c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59666/0 (socket says 172.21.15.100:59666) 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 -- 172.21.15.100:0/778047926 learned_addr learned my addr 172.21.15.100:0/778047926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2affd640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c100930 0x7f9f2c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 -- 172.21.15.100:0/778047926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f2c10e4e0 msgr2=0x7f9f2c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f2c10e4e0 0x7f9f2c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 -- 172.21.15.100:0/778047926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c100930 msgr2=0x7f9f2c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c100930 0x7f9f2c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 -- 172.21.15.100:0/778047926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c19f5f0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f2a7fc640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c1012e0 0x7f9f2c19ab80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400d950 tx=0x7f9f1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f23fff640 1 -- 172.21.15.100:0/778047926 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14017070 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f23fff640 1 -- 172.21.15.100:0/778047926 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f14009c30 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c19f8e0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f23fff640 1 -- 172.21.15.100:0/778047926 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400f6b0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.258+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c1a71c0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.260+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c100d10 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.260+0000 7f9f23fff640 1 -- 172.21.15.100:0/778047926 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9f140109d0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.261+0000 7f9f23fff640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9f180a2c90 0x7f9f180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.261+0000 7f9f2affd640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9f180a2c90 0x7f9f180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.261+0000 7f9f23fff640 1 -- 172.21.15.100:0/778047926 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9f140cedc0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.262+0000 7f9f2affd640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9f180a2c90 0x7f9f180a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c005fd0 tx=0x7f9f1c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.266+0000 7f9f23fff640 1 -- 172.21.15.100:0/778047926 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f14009de0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.361 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:59 smithi100 ceph-mon[31179]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:05:59.361 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:05:59 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/867380910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:05:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:59 smithi117 ceph-mon[35240]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:05:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:05:59 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/867380910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:05:59.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.438+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9f2c1090e0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.438+0000 7f9f23fff640 1 -- 172.21.15.100:0/778047926 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9f1409bbd0 con 0x7f9f2c1012e0 2024-09-12T02:05:59.439 INFO:teuthology.orchestra.run.smithi100.stdout:150323855412 2024-09-12T02:05:59.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9f180a2c90 msgr2=0x7f9f180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9f180a2c90 0x7f9f180a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c005fd0 tx=0x7f9f1c005850 comp rx=0 tx=0).stop 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c1012e0 msgr2=0x7f9f2c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c1012e0 0x7f9f2c19ab80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400d950 tx=0x7f9f1400de10 comp rx=0 tx=0).stop 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 shutdown_connections 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9f180a2c90 0x7f9f180a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f2c10e4e0 0x7f9f2c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f2c1012e0 0x7f9f2c19ab80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 --2- 172.21.15.100:0/778047926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c100930 0x7f9f2c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.440+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 >> 172.21.15.100:0/778047926 conn(0x7f9f2c0fc7a0 msgr2=0x7f9f2c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.441+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 shutdown_connections 2024-09-12T02:05:59.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:05:59.441+0000 7f9f315ee640 1 -- 172.21.15.100:0/778047926 wait complete. 2024-09-12T02:05:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:59 smithi189 ceph-mon[35188]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:05:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:05:59 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/867380910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:06:00.135 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855410 got 150323855412 for osd.5 2024-09-12T02:06:00.135 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:00.353 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:00 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/778047926' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:06:00.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:00 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/778047926' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:06:00.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.544+0000 7f0b9f33b640 1 -- 172.21.15.100:0/801094322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 msgr2=0x7f0b9810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.544+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/801094322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9810ec70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009930 tx=0x7f0b9002a420 comp rx=0 tx=0).stop 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.544+0000 7f0b9f33b640 1 -- 172.21.15.100:0/801094322 shutdown_connections 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/801094322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9810ec70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/801094322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b98103780 0x7f0b98107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/801094322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b98102dd0 0x7f0b981031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 -- 172.21.15.100:0/801094322 >> 172.21.15.100:0/801094322 conn(0x7f0b980fc7d0 msgr2=0x7f0b980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 -- 172.21.15.100:0/801094322 shutdown_connections 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 -- 172.21.15.100:0/801094322 wait complete. 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 Processor -- start 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.545+0000 7f0b9f33b640 1 -- start start 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9f33b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b98102dd0 0x7f0b981985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9f33b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b98103780 0x7f0b98198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9f33b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9f33b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98112110 con 0x7f0b98108300 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9f33b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98111f90 con 0x7f0b98102dd0 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9f33b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98112290 con 0x7f0b98103780 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59688/0 (socket says 172.21.15.100:59688) 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 -- 172.21.15.100:0/1562011903 learned_addr learned my addr 172.21.15.100:0/1562011903 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d0d7640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b98102dd0 0x7f0b981985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9c8d6640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b98103780 0x7f0b98198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 -- 172.21.15.100:0/1562011903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b98103780 msgr2=0x7f0b98198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b98103780 0x7f0b98198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 -- 172.21.15.100:0/1562011903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b98102dd0 msgr2=0x7f0b981985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b98102dd0 0x7f0b981985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 -- 172.21.15.100:0/1562011903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9819d550 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.546+0000 7f0b9d8d8640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9819ce70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b90005ab0 tx=0x7f0b900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.547+0000 7f0b967fc640 1 -- 172.21.15.100:0/1562011903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9003f030 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.547+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9819d7e0 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.547+0000 7f0b967fc640 1 -- 172.21.15.100:0/1562011903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b90003ce0 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.547+0000 7f0b967fc640 1 -- 172.21.15.100:0/1562011903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90035070 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.547+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b981a5120 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.548+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9806a7b0 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.549+0000 7f0b967fc640 1 -- 172.21.15.100:0/1562011903 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0b90042030 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.550+0000 7f0b967fc640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0b800a2c10 0x7f0b800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.550+0000 7f0b9d0d7640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0b800a2c10 0x7f0b800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.550+0000 7f0b967fc640 1 -- 172.21.15.100:0/1562011903 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0b900efad0 con 0x7f0b98108300 2024-09-12T02:06:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.550+0000 7f0b9d0d7640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0b800a2c10 0x7f0b800a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009990 tx=0x7f0b88009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:00.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.553+0000 7f0b967fc640 1 -- 172.21.15.100:0/1562011903 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b900bc9a0 con 0x7f0b98108300 2024-09-12T02:06:00.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:00 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/778047926' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:06:00.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.749+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0b981031b0 con 0x7f0b98108300 2024-09-12T02:06:00.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.749+0000 7f0b967fc640 1 -- 172.21.15.100:0/1562011903 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0b981031b0 con 0x7f0b98108300 2024-09-12T02:06:00.749 INFO:teuthology.orchestra.run.smithi100.stdout:128849018938 2024-09-12T02:06:00.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0b800a2c10 msgr2=0x7f0b800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0b800a2c10 0x7f0b800a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009990 tx=0x7f0b88009110 comp rx=0 tx=0).stop 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 msgr2=0x7f0b9819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9819ce70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b90005ab0 tx=0x7f0b900042f0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 shutdown_connections 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0b800a2c10 0x7f0b800a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b98108300 0x7f0b9819ce70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b98103780 0x7f0b98198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 --2- 172.21.15.100:0/1562011903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b98102dd0 0x7f0b981985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.751+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 >> 172.21.15.100:0/1562011903 conn(0x7f0b980fc7d0 msgr2=0x7f0b98105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.752+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 shutdown_connections 2024-09-12T02:06:00.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.752+0000 7f0b9f33b640 1 -- 172.21.15.100:0/1562011903 wait complete. 2024-09-12T02:06:00.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 -- 172.21.15.100:0/2730503496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074620 msgr2=0x7f5c48074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 --2- 172.21.15.100:0/2730503496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074620 0x7f5c48074a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009900 tx=0x7f5c3c02a480 comp rx=0 tx=0).stop 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 -- 172.21.15.100:0/2730503496 shutdown_connections 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 --2- 172.21.15.100:0/2730503496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c4810e3d0 0x7f5c48110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 --2- 172.21.15.100:0/2730503496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c48074f40 0x7f5c4810de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 --2- 172.21.15.100:0/2730503496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074620 0x7f5c48074a00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 -- 172.21.15.100:0/2730503496 >> 172.21.15.100:0/2730503496 conn(0x7f5c480fd8f0 msgr2=0x7f5c480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 -- 172.21.15.100:0/2730503496 shutdown_connections 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.730+0000 7f5c4f220640 1 -- 172.21.15.100:0/2730503496 wait complete. 2024-09-12T02:06:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 Processor -- start 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 -- start start 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c48074620 0x7f5c4819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074f40 0x7f5c4819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c4810e3d0 0x7f5c4819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48114180 con 0x7f5c48074f40 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48114000 con 0x7f5c48074620 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4f220640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48114300 con 0x7f5c4810e3d0 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074f40 0x7f5c4819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074f40 0x7f5c4819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59714/0 (socket says 172.21.15.100:59714) 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 -- 172.21.15.100:0/1632215275 learned_addr learned my addr 172.21.15.100:0/1632215275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4cfbc640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c48074620 0x7f5c4819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 -- 172.21.15.100:0/1632215275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c4810e3d0 msgr2=0x7f5c4819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4d7bd640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c4810e3d0 0x7f5c4819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c4810e3d0 0x7f5c4819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 -- 172.21.15.100:0/1632215275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c48074620 msgr2=0x7f5c4819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c48074620 0x7f5c4819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c47fff640 1 -- 172.21.15.100:0/1632215275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4819f6a0 con 0x7f5c48074f40 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4cfbc640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c48074620 0x7f5c4819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.731+0000 7f5c4d7bd640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c4810e3d0 0x7f5c4819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.732+0000 7f5c47fff640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074f40 0x7f5c4819ac30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c970 tx=0x7f5c3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.732+0000 7f5c45ffb640 1 -- 172.21.15.100:0/1632215275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34007bb0 con 0x7f5c48074f40 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.732+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4819f990 con 0x7f5c48074f40 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.732+0000 7f5c45ffb640 1 -- 172.21.15.100:0/1632215275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c34007d50 con 0x7f5c48074f40 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.732+0000 7f5c45ffb640 1 -- 172.21.15.100:0/1632215275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400f450 con 0x7f5c48074f40 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.732+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c481a7270 con 0x7f5c48074f40 2024-09-12T02:06:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.733+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c48074a00 con 0x7f5c48074f40 2024-09-12T02:06:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.734+0000 7f5c45ffb640 1 -- 172.21.15.100:0/1632215275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5c34004fe0 con 0x7f5c48074f40 2024-09-12T02:06:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.735+0000 7f5c45ffb640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5c380a2c10 0x7f5c380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.735+0000 7f5c4cfbc640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5c380a2c10 0x7f5c380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.735+0000 7f5c45ffb640 1 -- 172.21.15.100:0/1632215275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5c340cf440 con 0x7f5c48074f40 2024-09-12T02:06:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.735+0000 7f5c4cfbc640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5c380a2c10 0x7f5c380a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000c00 tx=0x7f5c3c032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.742+0000 7f5c45ffb640 1 -- 172.21.15.100:0/1632215275 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c34014030 con 0x7f5c48074f40 2024-09-12T02:06:00.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.924+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5c4819ba50 con 0x7f5c48074f40 2024-09-12T02:06:00.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.924+0000 7f5c45ffb640 1 -- 172.21.15.100:0/1632215275 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5c4819ba50 con 0x7f5c48074f40 2024-09-12T02:06:00.925 INFO:teuthology.orchestra.run.smithi100.stdout:317827579927 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.927+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5c380a2c10 msgr2=0x7f5c380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.927+0000 7f5c4f220640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5c380a2c10 0x7f5c380a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000c00 tx=0x7f5c3c032d50 comp rx=0 tx=0).stop 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.927+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074f40 msgr2=0x7f5c4819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.927+0000 7f5c4f220640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074f40 0x7f5c4819ac30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c970 tx=0x7f5c3400ce30 comp rx=0 tx=0).stop 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.927+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 shutdown_connections 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.927+0000 7f5c4f220640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5c380a2c10 0x7f5c380a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.927+0000 7f5c4f220640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c4810e3d0 0x7f5c4819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.928+0000 7f5c4f220640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48074f40 0x7f5c4819ac30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.928+0000 7f5c4f220640 1 --2- 172.21.15.100:0/1632215275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c48074620 0x7f5c4819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.928+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 >> 172.21.15.100:0/1632215275 conn(0x7f5c480fd8f0 msgr2=0x7f5c480ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.928+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 shutdown_connections 2024-09-12T02:06:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:00.928+0000 7f5c4f220640 1 -- 172.21.15.100:0/1632215275 wait complete. 2024-09-12T02:06:01.285 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:01 smithi100 ceph-mon[31179]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-12T02:06:01.285 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:01 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1562011903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:06:01.285 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:01 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1632215275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:06:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:01 smithi117 ceph-mon[35240]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-12T02:06:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:01 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1562011903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:06:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:01 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1632215275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:06:01.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:01 smithi189 ceph-mon[35188]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-12T02:06:01.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:01 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1562011903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:06:01.494 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:01 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1632215275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:06:01.794 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579924 got 317827579927 for osd.11 2024-09-12T02:06:01.794 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 -- 172.21.15.100:0/4207777798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 msgr2=0x7f45f81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 --2- 172.21.15.100:0/4207777798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f81021c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009900 tx=0x7f45f402a410 comp rx=0 tx=0).stop 2024-09-12T02:06:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 -- 172.21.15.100:0/4207777798 shutdown_connections 2024-09-12T02:06:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 --2- 172.21.15.100:0/4207777798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f8106f10 0x7f45f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 --2- 172.21.15.100:0/4207777798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f8102790 0x7f45f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 --2- 172.21.15.100:0/4207777798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f81021c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 -- 172.21.15.100:0/4207777798 >> 172.21.15.100:0/4207777798 conn(0x7f45f80fd8c0 msgr2=0x7f45f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 -- 172.21.15.100:0/4207777798 shutdown_connections 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.183+0000 7f45ff78c640 1 -- 172.21.15.100:0/4207777798 wait complete. 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 Processor -- start 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 -- start start 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f8102790 0x7f45f8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f8106f10 0x7f45f819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8111f70 con 0x7f45f8101de0 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8111df0 con 0x7f45f8102790 2024-09-12T02:06:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45ff78c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81120f0 con 0x7f45f8106f10 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45fd528640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45fd528640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59744/0 (socket says 172.21.15.100:59744) 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45fd528640 1 -- 172.21.15.100:0/1011977830 learned_addr learned my addr 172.21.15.100:0/1011977830 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.184+0000 7f45fdd29640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f8106f10 0x7f45f819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fcd27640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f8102790 0x7f45f8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fd528640 1 -- 172.21.15.100:0/1011977830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f8106f10 msgr2=0x7f45f819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fd528640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f8106f10 0x7f45f819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fd528640 1 -- 172.21.15.100:0/1011977830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f8102790 msgr2=0x7f45f8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fd528640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f8102790 0x7f45f8198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fd528640 1 -- 172.21.15.100:0/1011977830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f819d3e0 con 0x7f45f8101de0 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fcd27640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f8102790 0x7f45f8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45fd528640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f8198430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006010 tx=0x7f45f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45ee7fc640 1 -- 172.21.15.100:0/1011977830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f403f030 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45ee7fc640 1 -- 172.21.15.100:0/1011977830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f4003ce0 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f819d670 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45ee7fc640 1 -- 172.21.15.100:0/1011977830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4035070 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.185+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f81a4fb0 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.186+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f81032c0 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.187+0000 7f45ee7fc640 1 -- 172.21.15.100:0/1011977830 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f45f4042030 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.188+0000 7f45ee7fc640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e40a2c90 0x7f45e40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.188+0000 7f45fcd27640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e40a2c90 0x7f45e40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.188+0000 7f45ee7fc640 1 -- 172.21.15.100:0/1011977830 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45f40ef720 con 0x7f45f8101de0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.188+0000 7f45fcd27640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e40a2c90 0x7f45e40a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45e80058c0 tx=0x7f45e8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.192+0000 7f45ee7fc640 1 -- 172.21.15.100:0/1011977830 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45f40bc5f0 con 0x7f45f8101de0 2024-09-12T02:06:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.363+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f45f810a0f0 con 0x7f45f8101de0 2024-09-12T02:06:02.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:02 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.363+0000 7f45ee7fc640 1 -- 172.21.15.100:0/1011977830 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f45f40bbef0 con 0x7f45f8101de0 2024-09-12T02:06:02.364 INFO:teuthology.orchestra.run.smithi100.stdout:231928234023 2024-09-12T02:06:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e40a2c90 msgr2=0x7f45e40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e40a2c90 0x7f45e40a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45e80058c0 tx=0x7f45e8005850 comp rx=0 tx=0).stop 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 msgr2=0x7f45f8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f8198430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006010 tx=0x7f45f40042f0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 shutdown_connections 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e40a2c90 0x7f45e40a5150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f8106f10 0x7f45f819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f8102790 0x7f45f8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 --2- 172.21.15.100:0/1011977830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f8101de0 0x7f45f8198430 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 >> 172.21.15.100:0/1011977830 conn(0x7f45f80fd8c0 msgr2=0x7f45f80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 shutdown_connections 2024-09-12T02:06:02.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:02.365+0000 7f45ff78c640 1 -- 172.21.15.100:0/1011977830 wait complete. 2024-09-12T02:06:02.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:02 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:02.448 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:02 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:03.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:03 smithi100 ceph-mon[31179]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:03.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:03 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1011977830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:06:03.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:03 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:03 smithi117 ceph-mon[35240]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:03 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1011977830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:06:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:03 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018935 got 128849018938 for osd.4 2024-09-12T02:06:03.410 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:03.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.040+0000 7f8fbb885640 1 -- 172.21.15.100:0/1005474599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 msgr2=0x7f8fb4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:03.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.040+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1005474599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4101200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009900 tx=0x7f8fb002a480 comp rx=0 tx=0).stop 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.040+0000 7f8fbb885640 1 -- 172.21.15.100:0/1005474599 shutdown_connections 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.040+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1005474599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb4102ef0 0x7f8fb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.040+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1005474599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb4102570 0x7f8fb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.040+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1005474599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4101200 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.040+0000 7f8fbb885640 1 -- 172.21.15.100:0/1005474599 >> 172.21.15.100:0/1005474599 conn(0x7f8fb40fc7d0 msgr2=0x7f8fb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.041+0000 7f8fbb885640 1 -- 172.21.15.100:0/1005474599 shutdown_connections 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.041+0000 7f8fbb885640 1 -- 172.21.15.100:0/1005474599 wait complete. 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.041+0000 7f8fbb885640 1 Processor -- start 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.041+0000 7f8fbb885640 1 -- start start 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fbb885640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fbb885640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb4102570 0x7f8fb4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fbb885640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb4102ef0 0x7f8fb419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fbb885640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41120d0 con 0x7f8fb4100e20 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fbb885640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4111f50 con 0x7f8fb4102570 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fbb885640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4112250 con 0x7f8fb4102ef0 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59772/0 (socket says 172.21.15.100:59772) 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 -- 172.21.15.100:0/1856652973 learned_addr learned my addr 172.21.15.100:0/1856652973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb8e20640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb4102570 0x7f8fb4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9e22640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb4102ef0 0x7f8fb419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 -- 172.21.15.100:0/1856652973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb4102ef0 msgr2=0x7f8fb419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb4102ef0 0x7f8fb419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 -- 172.21.15.100:0/1856652973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb4102570 msgr2=0x7f8fb4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb4102570 0x7f8fb4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 -- 172.21.15.100:0/1856652973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb419d540 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb8e20640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb4102570 0x7f8fb4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.042+0000 7f8fb9621640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4198590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8fb002a9f0 tx=0x7f8fb0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.043+0000 7f8faa7fc640 1 -- 172.21.15.100:0/1856652973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb003f070 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.043+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb419d7d0 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.043+0000 7f8faa7fc640 1 -- 172.21.15.100:0/1856652973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fb0031c20 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.043+0000 7f8faa7fc640 1 -- 172.21.15.100:0/1856652973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0035030 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.043+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41a5110 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.044+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb4101200 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.046+0000 7f8faa7fc640 1 -- 172.21.15.100:0/1856652973 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8fb0042070 con 0x7f8fb4100e20 2024-09-12T02:06:03.484 INFO:teuthology.orchestra.run.smithi100.stdout:34359738446 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.046+0000 7f8faa7fc640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8fa00a2c60 0x7f8fa00a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.047+0000 7f8fb8e20640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8fa00a2c60 0x7f8fa00a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.047+0000 7f8faa7fc640 1 -- 172.21.15.100:0/1856652973 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8fb00ef420 con 0x7f8fb4100e20 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.047+0000 7f8fb8e20640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8fa00a2c60 0x7f8fa00a5120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40fffb0 tx=0x7f8fa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.051+0000 7f8faa7fc640 1 -- 172.21.15.100:0/1856652973 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fb00bbbe0 con 0x7f8fb4100e20 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.226+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8fb4109090 con 0x7f8fb4100e20 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.227+0000 7f8faa7fc640 1 -- 172.21.15.100:0/1856652973 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8fb00bfee0 con 0x7f8fb4100e20 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8fa00a2c60 msgr2=0x7f8fa00a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8fa00a2c60 0x7f8fa00a5120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40fffb0 tx=0x7f8fa4005f90 comp rx=0 tx=0).stop 2024-09-12T02:06:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 msgr2=0x7f8fb4198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4198590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8fb002a9f0 tx=0x7f8fb0003b90 comp rx=0 tx=0).stop 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 shutdown_connections 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8fa00a2c60 0x7f8fa00a5120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fb4102ef0 0x7f8fb419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb4102570 0x7f8fb4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 --2- 172.21.15.100:0/1856652973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb4100e20 0x7f8fb4198590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 >> 172.21.15.100:0/1856652973 conn(0x7f8fb40fc7d0 msgr2=0x7f8fb40fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 shutdown_connections 2024-09-12T02:06:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:03.229+0000 7f8fbb885640 1 -- 172.21.15.100:0/1856652973 wait complete. 2024-09-12T02:06:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:03 smithi189 ceph-mon[35188]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:03 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1011977830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:06:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:03 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:04.097 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738446 for osd.0 2024-09-12T02:06:04.098 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:04.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 -- 172.21.15.100:0/1283112091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64100e20 msgr2=0x7f2c64101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 --2- 172.21.15.100:0/1283112091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64100e20 0x7f2c64101200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009900 tx=0x7f2c5402a480 comp rx=0 tx=0).stop 2024-09-12T02:06:04.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 -- 172.21.15.100:0/1283112091 shutdown_connections 2024-09-12T02:06:04.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 --2- 172.21.15.100:0/1283112091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c64102ef0 0x7f2c6410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 --2- 172.21.15.100:0/1283112091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64102570 0x7f2c641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 --2- 172.21.15.100:0/1283112091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64100e20 0x7f2c64101200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 -- 172.21.15.100:0/1283112091 >> 172.21.15.100:0/1283112091 conn(0x7f2c640fc7d0 msgr2=0x7f2c640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:04.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 -- 172.21.15.100:0/1283112091 shutdown_connections 2024-09-12T02:06:04.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 -- 172.21.15.100:0/1283112091 wait complete. 2024-09-12T02:06:04.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 Processor -- start 2024-09-12T02:06:04.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.276+0000 7f2c69589640 1 -- start start 2024-09-12T02:06:04.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c69589640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64100e20 0x7f2c64103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c69589640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64102570 0x7f2c64103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c69589640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c64102ef0 0x7f2c641041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c69589640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64110f80 con 0x7f2c64102570 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c69589640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64110e00 con 0x7f2c64100e20 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c69589640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64111100 con 0x7f2c64102ef0 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64102570 0x7f2c64103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c62ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64100e20 0x7f2c64103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c62ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64100e20 0x7f2c64103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42746/0 (socket says 172.21.15.100:42746) 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64102570 0x7f2c64103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59926/0 (socket says 172.21.15.100:59926) 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c62ffd640 1 -- 172.21.15.100:0/1429326099 learned_addr learned my addr 172.21.15.100:0/1429326099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c637fe640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c64102ef0 0x7f2c641041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 -- 172.21.15.100:0/1429326099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c64102ef0 msgr2=0x7f2c641041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c64102ef0 0x7f2c641041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 -- 172.21.15.100:0/1429326099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64100e20 msgr2=0x7f2c64103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64100e20 0x7f2c64103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 -- 172.21.15.100:0/1429326099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c641a6a20 con 0x7f2c64102570 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c62ffd640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64100e20 0x7f2c64103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c627fc640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64102570 0x7f2c64103c90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00d6d0 tx=0x7f2c4c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.277+0000 7f2c5bfff640 1 -- 172.21.15.100:0/1429326099 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c017070 con 0x7f2c64102570 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.278+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c641a6d10 con 0x7f2c64102570 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.278+0000 7f2c5bfff640 1 -- 172.21.15.100:0/1429326099 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c4c009820 con 0x7f2c64102570 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.278+0000 7f2c5bfff640 1 -- 172.21.15.100:0/1429326099 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c004d00 con 0x7f2c64102570 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.278+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c641a71f0 con 0x7f2c64102570 2024-09-12T02:06:04.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.279+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c64101200 con 0x7f2c64102570 2024-09-12T02:06:04.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.280+0000 7f2c5bfff640 1 -- 172.21.15.100:0/1429326099 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2c4c0099d0 con 0x7f2c64102570 2024-09-12T02:06:04.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.280+0000 7f2c5bfff640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2c500a2c10 0x7f2c500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.280+0000 7f2c62ffd640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2c500a2c10 0x7f2c500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.280+0000 7f2c5bfff640 1 -- 172.21.15.100:0/1429326099 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c4c0cec90 con 0x7f2c64102570 2024-09-12T02:06:04.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.281+0000 7f2c62ffd640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2c500a2c10 0x7f2c500a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2c540096c0 tx=0x7f2c54005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:04.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.284+0000 7f2c5bfff640 1 -- 172.21.15.100:0/1429326099 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c4c0d4020 con 0x7f2c64102570 2024-09-12T02:06:04.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:04 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1856652973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:06:04.421 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:04 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1856652973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:06:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.460+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2c641a7420 con 0x7f2c64102570 2024-09-12T02:06:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.460+0000 7f2c5bfff640 1 -- 172.21.15.100:0/1429326099 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c4c09b450 con 0x7f2c64102570 2024-09-12T02:06:04.460 INFO:teuthology.orchestra.run.smithi100.stdout:55834574922 2024-09-12T02:06:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2c500a2c10 msgr2=0x7f2c500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2c500a2c10 0x7f2c500a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2c540096c0 tx=0x7f2c54005a20 comp rx=0 tx=0).stop 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64102570 msgr2=0x7f2c64103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64102570 0x7f2c64103c90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00d6d0 tx=0x7f2c4c00db90 comp rx=0 tx=0).stop 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 shutdown_connections 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2c500a2c10 0x7f2c500a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c64102ef0 0x7f2c641041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c64102570 0x7f2c64103c90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 --2- 172.21.15.100:0/1429326099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64100e20 0x7f2c64103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 >> 172.21.15.100:0/1429326099 conn(0x7f2c640fc7d0 msgr2=0x7f2c6406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 shutdown_connections 2024-09-12T02:06:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.462+0000 7f2c69589640 1 -- 172.21.15.100:0/1429326099 wait complete. 2024-09-12T02:06:04.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 -- 172.21.15.100:0/48466960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050010e450 msgr2=0x7f05001108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 --2- 172.21.15.100:0/48466960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050010e450 0x7f05001108a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009ca0 tx=0x7f04f802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 -- 172.21.15.100:0/48466960 shutdown_connections 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 --2- 172.21.15.100:0/48466960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f050010e450 0x7f05001108a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 --2- 172.21.15.100:0/48466960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0500074f70 0x7f050010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 --2- 172.21.15.100:0/48466960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05000745c0 0x7f05000749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 -- 172.21.15.100:0/48466960 >> 172.21.15.100:0/48466960 conn(0x7f05000fd8d0 msgr2=0x7f05000ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 -- 172.21.15.100:0/48466960 shutdown_connections 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 -- 172.21.15.100:0/48466960 wait complete. 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 Processor -- start 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.505+0000 7f050783c640 1 -- start start 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f050783c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05000745c0 0x7f050019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f050783c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0500074f70 0x7f050019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f050783c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050010e450 0x7f050019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f050783c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f05001142b0 con 0x7f0500074f70 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f050783c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0500114130 con 0x7f05000745c0 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f050783c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0500114430 con 0x7f050010e450 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0500074f70 0x7f050019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0500074f70 0x7f050019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59946/0 (socket says 172.21.15.100:59946) 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 -- 172.21.15.100:0/3189524835 learned_addr learned my addr 172.21.15.100:0/3189524835 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f05055d8640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05000745c0 0x7f050019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 -- 172.21.15.100:0/3189524835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050010e450 msgr2=0x7f050019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0505dd9640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050010e450 0x7f050019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050010e450 0x7f050019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 -- 172.21.15.100:0/3189524835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05000745c0 msgr2=0x7f050019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05000745c0 0x7f050019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 -- 172.21.15.100:0/3189524835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050019f660 con 0x7f0500074f70 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0505dd9640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050010e450 0x7f050019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f05055d8640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05000745c0 0x7f050019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f0504dd7640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0500074f70 0x7f050019abf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f04f000b450 tx=0x7f04f000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f04f67fc640 1 -- 172.21.15.100:0/3189524835 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0015020 con 0x7f0500074f70 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050019f950 con 0x7f0500074f70 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.506+0000 7f04f67fc640 1 -- 172.21.15.100:0/3189524835 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04f0011d70 con 0x7f0500074f70 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.507+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05001a7230 con 0x7f0500074f70 2024-09-12T02:06:04.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.507+0000 7f04f67fc640 1 -- 172.21.15.100:0/3189524835 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f000f340 con 0x7f0500074f70 2024-09-12T02:06:04.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.507+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05000749a0 con 0x7f0500074f70 2024-09-12T02:06:04.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.509+0000 7f04f67fc640 1 -- 172.21.15.100:0/3189524835 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f04f0018020 con 0x7f0500074f70 2024-09-12T02:06:04.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.509+0000 7f04f67fc640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f04ec0a2c10 0x7f04ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:04.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.509+0000 7f04f67fc640 1 -- 172.21.15.100:0/3189524835 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f04f00cf160 con 0x7f0500074f70 2024-09-12T02:06:04.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.509+0000 7f05055d8640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f04ec0a2c10 0x7f04ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:04.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.510+0000 7f05055d8640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f04ec0a2c10 0x7f04ec0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00baa0 tx=0x7f04fc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:04.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.513+0000 7f04f67fc640 1 -- 172.21.15.100:0/3189524835 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04f001f020 con 0x7f0500074f70 2024-09-12T02:06:04.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:04 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1856652973' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:06:04.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.681+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f05001a7490 con 0x7f0500074f70 2024-09-12T02:06:04.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.681+0000 7f04f67fc640 1 -- 172.21.15.100:0/3189524835 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04f000d040 con 0x7f0500074f70 2024-09-12T02:06:04.681 INFO:teuthology.orchestra.run.smithi100.stdout:98784247871 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f04ec0a2c10 msgr2=0x7f04ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f04ec0a2c10 0x7f04ec0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00baa0 tx=0x7f04fc005d90 comp rx=0 tx=0).stop 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0500074f70 msgr2=0x7f050019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0500074f70 0x7f050019abf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f04f000b450 tx=0x7f04f000b910 comp rx=0 tx=0).stop 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 shutdown_connections 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f04ec0a2c10 0x7f04ec0a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050010e450 0x7f050019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0500074f70 0x7f050019abf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 --2- 172.21.15.100:0/3189524835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05000745c0 0x7f050019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.683+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 >> 172.21.15.100:0/3189524835 conn(0x7f05000fd8d0 msgr2=0x7f05000fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.684+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 shutdown_connections 2024-09-12T02:06:04.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:04.684+0000 7f050783c640 1 -- 172.21.15.100:0/3189524835 wait complete. 2024-09-12T02:06:04.867 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:05.269 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:05 smithi100 ceph-mon[31179]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:05.269 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:05 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1429326099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:06:05.269 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:05 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3189524835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:06:05.296 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247867 got 98784247871 for osd.3 2024-09-12T02:06:05.297 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:05 smithi117 ceph-mon[35240]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:05 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1429326099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:06:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:05 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3189524835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:06:05.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:05 smithi189 ceph-mon[35188]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:05.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:05 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1429326099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:06:05.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:05 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3189524835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:06:05.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574922 for osd.1 2024-09-12T02:06:05.872 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:06.270 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234021 got 231928234023 for osd.8 2024-09-12T02:06:06.270 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/1156536910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 msgr2=0x7f0cd8074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/1156536910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd8074970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ca0 tx=0x7f0cc802a950 comp rx=0 tx=0).stop 2024-09-12T02:06:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/1156536910 shutdown_connections 2024-09-12T02:06:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/1156536910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd8112b90 0x7f0cd8114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/1156536910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd8074eb0 0x7f0cd8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/1156536910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd8074970 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/1156536910 >> 172.21.15.100:0/1156536910 conn(0x7f0cd80fd8c0 msgr2=0x7f0cd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/1156536910 shutdown_connections 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.478+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/1156536910 wait complete. 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 Processor -- start 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 -- start start 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd81a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd8074eb0 0x7f0cd81a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd8112b90 0x7f0cd819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8118650 con 0x7f0cd8074590 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81184d0 con 0x7f0cd8074eb0 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdfb9c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81187d0 con 0x7f0cd8112b90 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd81a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd81a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59966/0 (socket says 172.21.15.100:59966) 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 -- 172.21.15.100:0/4294510964 learned_addr learned my addr 172.21.15.100:0/4294510964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cde139640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd8112b90 0x7f0cd819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 -- 172.21.15.100:0/4294510964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd8112b90 msgr2=0x7f0cd819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd8112b90 0x7f0cd819eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 -- 172.21.15.100:0/4294510964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd8074eb0 msgr2=0x7f0cd81a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd8074eb0 0x7f0cd81a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cdd938640 1 -- 172.21.15.100:0/4294510964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd819f1f0 con 0x7f0cd8074590 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.479+0000 7f0cde139640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd8112b90 0x7f0cd819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.480+0000 7f0cdd938640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd81a4900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005cc0 tx=0x7f0cc802f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.480+0000 7f0cd6ffd640 1 -- 172.21.15.100:0/4294510964 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8034040 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.480+0000 7f0cd6ffd640 1 -- 172.21.15.100:0/4294510964 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cc8003e40 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.480+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd819f480 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.480+0000 7f0cd6ffd640 1 -- 172.21.15.100:0/4294510964 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8045480 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.480+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd81ab7d0 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.481+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd80749f0 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.482+0000 7f0cd6ffd640 1 -- 172.21.15.100:0/4294510964 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0cc8037020 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.483+0000 7f0cd6ffd640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cc00a2c90 0x7f0cc00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.483+0000 7f0cdd137640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cc00a2c90 0x7f0cc00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.483+0000 7f0cd6ffd640 1 -- 172.21.15.100:0/4294510964 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0cc80f02e0 con 0x7f0cd8074590 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.483+0000 7f0cdd137640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cc00a2c90 0x7f0cc00a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0cd81001e0 tx=0x7f0ccc006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.487+0000 7f0cd6ffd640 1 -- 172.21.15.100:0/4294510964 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cc80bd200 con 0x7f0cd8074590 2024-09-12T02:06:06.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.667+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f0cd819fff0 con 0x7f0cd8074590 2024-09-12T02:06:06.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.667+0000 7f0cd6ffd640 1 -- 172.21.15.100:0/4294510964 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0cc80bcb00 con 0x7f0cd8074590 2024-09-12T02:06:06.667 INFO:teuthology.orchestra.run.smithi100.stdout:266287972387 2024-09-12T02:06:06.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cc00a2c90 msgr2=0x7f0cc00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cc00a2c90 0x7f0cc00a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0cd81001e0 tx=0x7f0ccc006c90 comp rx=0 tx=0).stop 2024-09-12T02:06:06.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 msgr2=0x7f0cd81a4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:06.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd81a4900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005cc0 tx=0x7f0cc802f770 comp rx=0 tx=0).stop 2024-09-12T02:06:06.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 shutdown_connections 2024-09-12T02:06:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cc00a2c90 0x7f0cc00a5150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd8112b90 0x7f0cd819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cd8074eb0 0x7f0cd81a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 --2- 172.21.15.100:0/4294510964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cd8074590 0x7f0cd81a4900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 >> 172.21.15.100:0/4294510964 conn(0x7f0cd80fd8c0 msgr2=0x7f0cd80ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 shutdown_connections 2024-09-12T02:06:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:06.669+0000 7f0cdfb9c640 1 -- 172.21.15.100:0/4294510964 wait complete. 2024-09-12T02:06:07.371 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972384 got 266287972387 for osd.9 2024-09-12T02:06:07.371 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:07.371 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:06:07.371 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:06:07.395 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:07 smithi100 ceph-mon[31179]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:07.395 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:07 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4294510964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:06:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:07 smithi117 ceph-mon[35240]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:07 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/4294510964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:06:07.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:07 smithi189 ceph-mon[35188]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:07.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:07 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/4294510964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:06:07.859 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.252+0000 7f8326c38640 1 -- 172.21.15.100:0/612066327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 msgr2=0x7f832010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 --2- 172.21.15.100:0/612066327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 0x7f832010da40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8318009ca0 tx=0x7f831802a950 comp rx=0 tx=0).stop 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 -- 172.21.15.100:0/612066327 shutdown_connections 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 --2- 172.21.15.100:0/612066327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 0x7f832010da40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 --2- 172.21.15.100:0/612066327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8320102570 0x7f83201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 --2- 172.21.15.100:0/612066327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 0x7f8320101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 -- 172.21.15.100:0/612066327 >> 172.21.15.100:0/612066327 conn(0x7f83200fc7d0 msgr2=0x7f83200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:08.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 -- 172.21.15.100:0/612066327 shutdown_connections 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 -- 172.21.15.100:0/612066327 wait complete. 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 Processor -- start 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 -- start start 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 0x7f83201a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.253+0000 7f8326c38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8320102570 0x7f83201a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f8326c38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 0x7f832019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f8326c38640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8320111020 con 0x7f8320102ef0 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f8326c38640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8320110ea0 con 0x7f8320100e20 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f8326c38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83201111a0 con 0x7f8320102570 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 0x7f83201a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83251d5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 0x7f832019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 0x7f83201a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:42814/0 (socket says 172.21.15.100:42814) 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f8317fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8320102570 0x7f83201a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 -- 172.21.15.100:0/1420586954 learned_addr learned my addr 172.21.15.100:0/1420586954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 -- 172.21.15.100:0/1420586954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8320102570 msgr2=0x7f83201a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8320102570 0x7f83201a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 -- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 msgr2=0x7f832019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 0x7f832019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 -- 172.21.15.100:0/1420586954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832019af00 con 0x7f8320100e20 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83251d5640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 0x7f832019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.254+0000 7f83249d4640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 0x7f83201a0570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f831c00b4a0 tx=0x7f831c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.255+0000 7f8315ffb640 1 -- 172.21.15.100:0/1420586954 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c015020 con 0x7f8320100e20 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.255+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832019b1f0 con 0x7f8320100e20 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.255+0000 7f8315ffb640 1 -- 172.21.15.100:0/1420586954 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f831c011d10 con 0x7f8320100e20 2024-09-12T02:06:08.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.255+0000 7f8315ffb640 1 -- 172.21.15.100:0/1420586954 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c00f2e0 con 0x7f8320100e20 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.255+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83201a7560 con 0x7f8320100e20 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.256+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83201021b0 con 0x7f8320100e20 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.257+0000 7f8315ffb640 1 -- 172.21.15.100:0/1420586954 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f831c018020 con 0x7f8320100e20 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.257+0000 7f8315ffb640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f83080a2c10 0x7f83080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.258+0000 7f8317fff640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f83080a2c10 0x7f83080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.258+0000 7f8315ffb640 1 -- 172.21.15.100:0/1420586954 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f831c0cec40 con 0x7f8320100e20 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.258+0000 7f8317fff640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f83080a2c10 0x7f83080a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8320105390 tx=0x7f8310009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.261+0000 7f8315ffb640 1 -- 172.21.15.100:0/1420586954 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f831c01f020 con 0x7f8320100e20 2024-09-12T02:06:08.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.463+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83201066f0 con 0x7f83080a2c10 2024-09-12T02:06:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.469+0000 7f8315ffb640 1 -- 172.21.15.100:0/1420586954 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258712 (secure 0 0 0) 0x7f83201066f0 con 0x7f83080a2c10 2024-09-12T02:06:08.472 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f83080a2c10 msgr2=0x7f83080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f83080a2c10 0x7f83080a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8320105390 tx=0x7f8310009110 comp rx=0 tx=0).stop 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 msgr2=0x7f83201a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 0x7f83201a0570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f831c00b4a0 tx=0x7f831c00b8a0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 shutdown_connections 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f83080a2c10 0x7f83080a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8320102ef0 0x7f832019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8320102570 0x7f83201a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 --2- 172.21.15.100:0/1420586954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320100e20 0x7f83201a0570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:08.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 >> 172.21.15.100:0/1420586954 conn(0x7f83200fc7d0 msgr2=0x7f832006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:08.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.472+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 shutdown_connections 2024-09-12T02:06:08.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:08.473+0000 7f8326c38640 1 -- 172.21.15.100:0/1420586954 wait complete. 2024-09-12T02:06:09.150 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-12T02:06:08.030085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":441,"num_read_kb":332,"num_write":345,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353548,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588276,"statfs":{"total":1151940427776,"available":1151578394624,"internally_reserved":0,"allocated":12890112,"data_stored":7212231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002891"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:02.830823+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:02.830823+0000","last_peered":"2024-09-12T02:06:02.830823+0000","last_clean":"2024-09-12T02:06:02.830823+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:02.830823+0000","last_undegraded":"2024-09-12T02:06:02.830823+0000","last_fullsized":"2024-09-12T02:06:02.830823+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:01.829024+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:01.829024+0000","last_peered":"2024-09-12T02:06:01.829024+0000","last_clean":"2024-09-12T02:06:01.829024+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:01.829024+0000","last_undegraded":"2024-09-12T02:06:01.829024+0000","last_fullsized":"2024-09-12T02:06:01.829024+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":153,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:02.830238+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:02.830238+0000","last_peered":"2024-09-12T02:06:02.830238+0000","last_clean":"2024-09-12T02:06:02.830238+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:02.830238+0000","last_undegraded":"2024-09-12T02:06:02.830238+0000","last_fullsized":"2024-09-12T02:06:02.830238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":109,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:04.833228+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:04.833228+0000","last_peered":"2024-09-12T02:06:04.833228+0000","last_clean":"2024-09-12T02:06:04.833228+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:04.833228+0000","last_undegraded":"2024-09-12T02:06:04.833228+0000","last_fullsized":"2024-09-12T02:06:04.833228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275002+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275002+0000","last_peered":"2024-09-12T02:05:23.275002+0000","last_clean":"2024-09-12T02:05:23.275002+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275002+0000","last_undegraded":"2024-09-12T02:05:23.275002+0000","last_fullsized":"2024-09-12T02:05:23.275002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":75,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.831044+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:03.831044+0000","last_peered":"2024-09-12T02:06:03.831044+0000","last_clean":"2024-09-12T02:06:03.831044+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:03.831044+0000","last_undegraded":"2024-09-12T02:06:03.831044+0000","last_fullsized":"2024-09-12T02:06:03.831044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.127440+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:23.127440+0000","last_peered":"2024-09-12T02:05:23.127440+0000","last_clean":"2024-09-12T02:05:23.127440+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:23.127440+0000","last_undegraded":"2024-09-12T02:05:23.127440+0000","last_fullsized":"2024-09-12T02:05:23.127440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":315,"num_read_kb":223,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1589248,"data_stored":1089254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1029781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":498352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:09.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:06:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:09 smithi117 ceph-mon[35240]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:09.410 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:09.532 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:09 smithi100 ceph-mon[31179]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:09.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:09 smithi189 ceph-mon[35188]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:09.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 -- 172.21.15.100:0/326974146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 msgr2=0x7fa0cc100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/326974146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 0x7fa0cc100ec0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009930 tx=0x7fa0b802a420 comp rx=0 tx=0).stop 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 -- 172.21.15.100:0/326974146 shutdown_connections 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/326974146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc101400 0x7fa0cc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/326974146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 0x7fa0cc100ec0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/326974146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc106a60 0x7fa0cc106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 -- 172.21.15.100:0/326974146 >> 172.21.15.100:0/326974146 conn(0x7fa0cc0fc780 msgr2=0x7fa0cc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 -- 172.21.15.100:0/326974146 shutdown_connections 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 -- 172.21.15.100:0/326974146 wait complete. 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 Processor -- start 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.881+0000 7fa0d30b0640 1 -- start start 2024-09-12T02:06:09.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d30b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 0x7fa0cc198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d30b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc101400 0x7fa0cc198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d30b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc106a60 0x7fa0cc19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d30b0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc110e80 con 0x7fa0cc100a60 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d30b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc110d00 con 0x7fa0cc106a60 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d30b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc111000 con 0x7fa0cc101400 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0cbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc101400 0x7fa0cc198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0cbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc101400 0x7fa0cc198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:52056/0 (socket says 172.21.15.100:52056) 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d164d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc106a60 0x7fa0cc19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0cbfff640 1 -- 172.21.15.100:0/2919077380 learned_addr learned my addr 172.21.15.100:0/2919077380 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d0e4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 0x7fa0cc198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d0e4c640 1 -- 172.21.15.100:0/2919077380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc101400 msgr2=0x7fa0cc198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d0e4c640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc101400 0x7fa0cc198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d0e4c640 1 -- 172.21.15.100:0/2919077380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc106a60 msgr2=0x7fa0cc19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d0e4c640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc106a60 0x7fa0cc19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d0e4c640 1 -- 172.21.15.100:0/2919077380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc19d500 con 0x7fa0cc100a60 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0cbfff640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc101400 0x7fa0cc198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d164d640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc106a60 0x7fa0cc19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0d0e4c640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 0x7fa0cc198550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000b3f0 tx=0x7fa0c000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.882+0000 7fa0c9ffb640 1 -- 172.21.15.100:0/2919077380 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0015020 con 0x7fa0cc100a60 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.883+0000 7fa0c9ffb640 1 -- 172.21.15.100:0/2919077380 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0c0011d10 con 0x7fa0cc100a60 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.883+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0cc19d7f0 con 0x7fa0cc100a60 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.883+0000 7fa0c9ffb640 1 -- 172.21.15.100:0/2919077380 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000f2e0 con 0x7fa0cc100a60 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.883+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0cc1a50d0 con 0x7fa0cc100a60 2024-09-12T02:06:09.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.884+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0cc100ec0 con 0x7fa0cc100a60 2024-09-12T02:06:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.885+0000 7fa0c9ffb640 1 -- 172.21.15.100:0/2919077380 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa0c0018020 con 0x7fa0cc100a60 2024-09-12T02:06:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.885+0000 7fa0c9ffb640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0bc0a2c90 0x7fa0bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.886+0000 7fa0cbfff640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0bc0a2c90 0x7fa0bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.886+0000 7fa0c9ffb640 1 -- 172.21.15.100:0/2919077380 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa0c00ce7d0 con 0x7fa0cc100a60 2024-09-12T02:06:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.886+0000 7fa0cbfff640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0bc0a2c90 0x7fa0bc0a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc1051b0 tx=0x7fa0b8009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:09.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:09.890+0000 7fa0c9ffb640 1 -- 172.21.15.100:0/2919077380 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0c001f020 con 0x7fa0cc100a60 2024-09-12T02:06:10.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.057+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0cc062630 con 0x7fa0bc0a2c90 2024-09-12T02:06:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.063+0000 7fa0c9ffb640 1 -- 172.21.15.100:0/2919077380 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258712 (secure 0 0 0) 0x7fa0cc062630 con 0x7fa0bc0a2c90 2024-09-12T02:06:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:10.068 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0bc0a2c90 msgr2=0x7fa0bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0bc0a2c90 0x7fa0bc0a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc1051b0 tx=0x7fa0b8009560 comp rx=0 tx=0).stop 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 msgr2=0x7fa0cc198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 0x7fa0cc198550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000b3f0 tx=0x7fa0c000b8b0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 shutdown_connections 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa0bc0a2c90 0x7fa0bc0a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc106a60 0x7fa0cc19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0cc101400 0x7fa0cc198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 --2- 172.21.15.100:0/2919077380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0cc100a60 0x7fa0cc198550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:10.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 >> 172.21.15.100:0/2919077380 conn(0x7fa0cc0fc780 msgr2=0x7fa0cc06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:10.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 shutdown_connections 2024-09-12T02:06:10.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:10.066+0000 7fa0d30b0640 1 -- 172.21.15.100:0/2919077380 wait complete. 2024-09-12T02:06:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:10 smithi100 ceph-mon[31179]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:10.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:10.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:10 smithi117 ceph-mon[35240]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:10 smithi189 ceph-mon[35188]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:10.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:10.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:10.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:06:10.649 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-12T02:06:10.030484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":466,"num_read_kb":347,"num_write":345,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353548,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588276,"statfs":{"total":1151940427776,"available":1151578394624,"internally_reserved":0,"allocated":12890112,"data_stored":7212231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002710"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.838728+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:07.838728+0000","last_peered":"2024-09-12T02:06:07.838728+0000","last_clean":"2024-09-12T02:06:07.838728+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:07.838728+0000","last_undegraded":"2024-09-12T02:06:07.838728+0000","last_fullsized":"2024-09-12T02:06:07.838728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:06.836219+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:06.836219+0000","last_peered":"2024-09-12T02:06:06.836219+0000","last_clean":"2024-09-12T02:06:06.836219+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:06.836219+0000","last_undegraded":"2024-09-12T02:06:06.836219+0000","last_fullsized":"2024-09-12T02:06:06.836219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":163,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.837684+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:07.837684+0000","last_peered":"2024-09-12T02:06:07.837684+0000","last_clean":"2024-09-12T02:06:07.837684+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:07.837684+0000","last_undegraded":"2024-09-12T02:06:07.837684+0000","last_fullsized":"2024-09-12T02:06:07.837684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":114,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:04.833228+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:04.833228+0000","last_peered":"2024-09-12T02:06:04.833228+0000","last_clean":"2024-09-12T02:06:04.833228+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:04.833228+0000","last_undegraded":"2024-09-12T02:06:04.833228+0000","last_fullsized":"2024-09-12T02:06:04.833228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275002+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275002+0000","last_peered":"2024-09-12T02:05:23.275002+0000","last_clean":"2024-09-12T02:05:23.275002+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275002+0000","last_undegraded":"2024-09-12T02:05:23.275002+0000","last_fullsized":"2024-09-12T02:05:23.275002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.838523+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:08.838523+0000","last_peered":"2024-09-12T02:06:08.838523+0000","last_clean":"2024-09-12T02:06:08.838523+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:08.838523+0000","last_undegraded":"2024-09-12T02:06:08.838523+0000","last_fullsized":"2024-09-12T02:06:08.838523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.127440+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:23.127440+0000","last_peered":"2024-09-12T02:05:23.127440+0000","last_clean":"2024-09-12T02:05:23.127440+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:23.127440+0000","last_undegraded":"2024-09-12T02:05:23.127440+0000","last_fullsized":"2024-09-12T02:05:23.127440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":340,"num_read_kb":238,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1589248,"data_stored":1089254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234025,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1029781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":498352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:10.653 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:06:10.653 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:06:10.654 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:06:10.654 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T02:06:10.904 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:11.168 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:11 smithi100 ceph-mon[31179]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:11.168 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:11 smithi100 ceph-mon[31179]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 -- 172.21.15.100:0/1293383171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074102ef0 msgr2=0x7fc07410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 --2- 172.21.15.100:0/1293383171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074102ef0 0x7fc07410da40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc064009900 tx=0x7fc06402a480 comp rx=0 tx=0).stop 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 -- 172.21.15.100:0/1293383171 shutdown_connections 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 --2- 172.21.15.100:0/1293383171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074102ef0 0x7fc07410da40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 --2- 172.21.15.100:0/1293383171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc074102570 0x7fc0741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 --2- 172.21.15.100:0/1293383171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc074100e20 0x7fc074101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 -- 172.21.15.100:0/1293383171 >> 172.21.15.100:0/1293383171 conn(0x7fc0740fc7d0 msgr2=0x7fc0740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 -- 172.21.15.100:0/1293383171 shutdown_connections 2024-09-12T02:06:11.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 -- 172.21.15.100:0/1293383171 wait complete. 2024-09-12T02:06:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.336+0000 7fc079337640 1 Processor -- start 2024-09-12T02:06:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc079337640 1 -- start start 2024-09-12T02:06:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc079337640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074100e20 0x7fc074198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc079337640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc074102570 0x7fc074198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc079337640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc074102ef0 0x7fc07419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc079337640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc074110f80 con 0x7fc074100e20 2024-09-12T02:06:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc079337640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc074110e00 con 0x7fc074102ef0 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc079337640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc074111100 con 0x7fc074102570 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074100e20 0x7fc074198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074100e20 0x7fc074198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60010/0 (socket says 172.21.15.100:60010) 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 -- 172.21.15.100:0/812334636 learned_addr learned my addr 172.21.15.100:0/812334636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc0727fc640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc074102570 0x7fc074198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc0737fe640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc074102ef0 0x7fc07419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 -- 172.21.15.100:0/812334636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc074102570 msgr2=0x7fc074198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc074102570 0x7fc074198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 -- 172.21.15.100:0/812334636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc074102ef0 msgr2=0x7fc07419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc074102ef0 0x7fc07419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.337+0000 7fc072ffd640 1 -- 172.21.15.100:0/812334636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07419d4b0 con 0x7fc074100e20 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.338+0000 7fc072ffd640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074100e20 0x7fc074198500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00db80 tx=0x7fc06c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.338+0000 7fc06bfff640 1 -- 172.21.15.100:0/812334636 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c017070 con 0x7fc074100e20 2024-09-12T02:06:11.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.338+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07419d7a0 con 0x7fc074100e20 2024-09-12T02:06:11.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.338+0000 7fc06bfff640 1 -- 172.21.15.100:0/812334636 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc06c003b70 con 0x7fc074100e20 2024-09-12T02:06:11.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.338+0000 7fc06bfff640 1 -- 172.21.15.100:0/812334636 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0106c0 con 0x7fc074100e20 2024-09-12T02:06:11.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.338+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0740fcbb0 con 0x7fc074100e20 2024-09-12T02:06:11.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.339+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc074101200 con 0x7fc074100e20 2024-09-12T02:06:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.340+0000 7fc06bfff640 1 -- 172.21.15.100:0/812334636 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc06c004020 con 0x7fc074100e20 2024-09-12T02:06:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.340+0000 7fc06bfff640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc0600a2c10 0x7fc0600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.341+0000 7fc0727fc640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc0600a2c10 0x7fc0600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.341+0000 7fc06bfff640 1 -- 172.21.15.100:0/812334636 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc06c0cf010 con 0x7fc074100e20 2024-09-12T02:06:11.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.341+0000 7fc0727fc640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc0600a2c10 0x7fc0600a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc074105200 tx=0x7fc05c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:11.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.345+0000 7fc06bfff640 1 -- 172.21.15.100:0/812334636 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc06c020070 con 0x7fc074100e20 2024-09-12T02:06:11.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:11 smithi117 ceph-mon[35240]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:11 smithi117 ceph-mon[35240]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:11.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.572+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc07410a0a0 con 0x7fc074100e20 2024-09-12T02:06:11.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.572+0000 7fc06bfff640 1 -- 172.21.15.100:0/812334636 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc06c09be20 con 0x7fc074100e20 2024-09-12T02:06:11.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:11.574 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc0600a2c10 msgr2=0x7fc0600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc0600a2c10 0x7fc0600a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc074105200 tx=0x7fc05c00b390 comp rx=0 tx=0).stop 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074100e20 msgr2=0x7fc074198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074100e20 0x7fc074198500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00db80 tx=0x7fc06c00b630 comp rx=0 tx=0).stop 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 shutdown_connections 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc0600a2c10 0x7fc0600a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc074102ef0 0x7fc07419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc074102570 0x7fc074198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 --2- 172.21.15.100:0/812334636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc074100e20 0x7fc074198500 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.574+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 >> 172.21.15.100:0/812334636 conn(0x7fc0740fc7d0 msgr2=0x7fc07406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.575+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 shutdown_connections 2024-09-12T02:06:11.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:11.575+0000 7fc079337640 1 -- 172.21.15.100:0/812334636 wait complete. 2024-09-12T02:06:11.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:11 smithi189 ceph-mon[35188]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:11.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:11 smithi189 ceph-mon[35188]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:12.190 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:06:12.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:06:12.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:12 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/812334636' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:06:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:12.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:12 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/812334636' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:06:12.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:12 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/812334636' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:06:12.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 -- 172.21.15.100:0/3077174905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 msgr2=0x7fec7410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:12.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 --2- 172.21.15.100:0/3077174905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec7410d950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009cd0 tx=0x7fec6c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:06:12.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 -- 172.21.15.100:0/3077174905 shutdown_connections 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 --2- 172.21.15.100:0/3077174905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec7410d950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 --2- 172.21.15.100:0/3077174905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec74100a80 0x7fec74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 --2- 172.21.15.100:0/3077174905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec74106a80 0x7fec74106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 -- 172.21.15.100:0/3077174905 >> 172.21.15.100:0/3077174905 conn(0x7fec740fc7a0 msgr2=0x7fec740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 -- 172.21.15.100:0/3077174905 shutdown_connections 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 -- 172.21.15.100:0/3077174905 wait complete. 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 Processor -- start 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.891+0000 7fec7bda1640 1 -- start start 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7bda1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec74100a80 0x7fec741973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7bda1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec741978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7bda1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec74106a80 0x7fec7419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:12.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7bda1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fec74110ec0 con 0x7fec74101420 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7bda1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec74110d40 con 0x7fec74100a80 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7bda1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fec74111040 con 0x7fec74106a80 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec741978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec741978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60026/0 (socket says 172.21.15.100:60026) 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 -- 172.21.15.100:0/2644276547 learned_addr learned my addr 172.21.15.100:0/2644276547 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec79b3d640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec74100a80 0x7fec741973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 -- 172.21.15.100:0/2644276547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec74106a80 msgr2=0x7fec7419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec74106a80 0x7fec7419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 -- 172.21.15.100:0/2644276547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec74100a80 msgr2=0x7fec741973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec74100a80 0x7fec741973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 -- 172.21.15.100:0/2644276547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7419c350 con 0x7fec74101420 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7933c640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec741978e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fec6400b4a0 tx=0x7fec6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:12.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec6affd640 1 -- 172.21.15.100:0/2644276547 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64014070 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec6affd640 1 -- 172.21.15.100:0/2644276547 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec64010af0 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7419c640 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.892+0000 7fec6affd640 1 -- 172.21.15.100:0/2644276547 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64017d10 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.893+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec741a3f20 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.894+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec74100ee0 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.895+0000 7fec6affd640 1 -- 172.21.15.100:0/2644276547 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fec64017070 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.895+0000 7fec6affd640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec600a2c10 0x7fec600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.895+0000 7fec79b3d640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec600a2c10 0x7fec600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.895+0000 7fec6affd640 1 -- 172.21.15.100:0/2644276547 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fec640ce810 con 0x7fec74101420 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.896+0000 7fec79b3d640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec600a2c10 0x7fec600a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec70005fd0 tx=0x7fec7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:12.899+0000 7fec6affd640 1 -- 172.21.15.100:0/2644276547 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec6409b730 con 0x7fec74101420 2024-09-12T02:06:13.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.103+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec7402d7c0 con 0x7fec74101420 2024-09-12T02:06:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.104+0000 7fec6affd640 1 -- 172.21.15.100:0/2644276547 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11929 (secure 0 0 0) 0x7fec6409b030 con 0x7fec74101420 2024-09-12T02:06:13.105 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:13.105 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"btime":"2024-09-12T02:05:19:082439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:05:18.350451+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24433,24428]},"id":1}]} 2024-09-12T02:06:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-12T02:06:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec600a2c10 msgr2=0x7fec600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec600a2c10 0x7fec600a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec70005fd0 tx=0x7fec7000b390 comp rx=0 tx=0).stop 2024-09-12T02:06:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 msgr2=0x7fec741978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec741978e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fec6400b4a0 tx=0x7fec6400b960 comp rx=0 tx=0).stop 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 shutdown_connections 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec600a2c10 0x7fec600a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec74106a80 0x7fec7419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec74101420 0x7fec741978e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 --2- 172.21.15.100:0/2644276547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec74100a80 0x7fec741973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 >> 172.21.15.100:0/2644276547 conn(0x7fec740fc7a0 msgr2=0x7fec740fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 shutdown_connections 2024-09-12T02:06:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:13.106+0000 7fec7bda1640 1 -- 172.21.15.100:0/2644276547 wait complete. 2024-09-12T02:06:13.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:13 smithi100 ceph-mon[31179]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:13.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:13 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2644276547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:13.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:13 smithi189 ceph-mon[35188]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:13.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:13 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2644276547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:13.597 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:06:13.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:13 smithi117 ceph-mon[35240]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:13.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:13 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2644276547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:13.842 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:14.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 -- 172.21.15.100:0/49233819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220100a80 msgr2=0x7f4220100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:14.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 --2- 172.21.15.100:0/49233819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220100a80 0x7f4220100ee0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4214009930 tx=0x7f421402a420 comp rx=0 tx=0).stop 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 -- 172.21.15.100:0/49233819 shutdown_connections 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 --2- 172.21.15.100:0/49233819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220101420 0x7f422010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 --2- 172.21.15.100:0/49233819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220100a80 0x7f4220100ee0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 --2- 172.21.15.100:0/49233819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106a80 0x7f4220106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 -- 172.21.15.100:0/49233819 >> 172.21.15.100:0/49233819 conn(0x7f42200fc7a0 msgr2=0x7f42200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 -- 172.21.15.100:0/49233819 shutdown_connections 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.367+0000 7f4225b48640 1 -- 172.21.15.100:0/49233819 wait complete. 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 Processor -- start 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 -- start start 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220100a80 0x7f4220199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101420 0x7f4220199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106a80 0x7f42201a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4220110e80 con 0x7f4220101420 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4220110d00 con 0x7f4220100a80 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f4225b48640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4220111000 con 0x7f4220106a80 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101420 0x7f4220199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101420 0x7f4220199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57064/0 (socket says 172.21.15.100:57064) 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 -- 172.21.15.100:0/4059517915 learned_addr learned my addr 172.21.15.100:0/4059517915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421ffff640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106a80 0x7f42201a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421f7fe640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220100a80 0x7f4220199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 -- 172.21.15.100:0/4059517915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106a80 msgr2=0x7f42201a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106a80 0x7f42201a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 -- 172.21.15.100:0/4059517915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220100a80 msgr2=0x7f4220199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220100a80 0x7f4220199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421effd640 1 -- 172.21.15.100:0/4059517915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42201a4800 con 0x7f4220101420 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.368+0000 7f421f7fe640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220100a80 0x7f4220199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.369+0000 7f421effd640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101420 0x7f4220199780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4214009a50 tx=0x7f4214004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.369+0000 7f421cff9640 1 -- 172.21.15.100:0/4059517915 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421403f030 con 0x7f4220101420 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.369+0000 7f421cff9640 1 -- 172.21.15.100:0/4059517915 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4214003ce0 con 0x7f4220101420 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.369+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42201a49d0 con 0x7f4220101420 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.369+0000 7f421cff9640 1 -- 172.21.15.100:0/4059517915 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214035070 con 0x7f4220101420 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.369+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42201a4e80 con 0x7f4220101420 2024-09-12T02:06:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.370+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4220100ee0 con 0x7f4220101420 2024-09-12T02:06:14.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.371+0000 7f421cff9640 1 -- 172.21.15.100:0/4059517915 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4214042030 con 0x7f4220101420 2024-09-12T02:06:14.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.372+0000 7f421cff9640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f42080a2c10 0x7f42080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:14.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.372+0000 7f421f7fe640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f42080a2c10 0x7f42080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:14.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.372+0000 7f421cff9640 1 -- 172.21.15.100:0/4059517915 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f42140efc60 con 0x7f4220101420 2024-09-12T02:06:14.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.372+0000 7f421f7fe640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f42080a2c10 0x7f42080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f42100058c0 tx=0x7f4210005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:14.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.375+0000 7f421cff9640 1 -- 172.21.15.100:0/4059517915 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42140bca70 con 0x7f4220101420 2024-09-12T02:06:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.576+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f422006adc0 con 0x7f4220101420 2024-09-12T02:06:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.576+0000 7f421cff9640 1 -- 172.21.15.100:0/4059517915 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11929 (secure 0 0 0) 0x7f42140bc370 con 0x7f4220101420 2024-09-12T02:06:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:14.578 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"btime":"2024-09-12T02:05:19:082439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:05:18.350451+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24433,24428]},"id":1}]} 2024-09-12T02:06:14.578 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f42080a2c10 msgr2=0x7f42080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f42080a2c10 0x7f42080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f42100058c0 tx=0x7f4210005cb0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101420 msgr2=0x7f4220199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101420 0x7f4220199780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4214009a50 tx=0x7f4214004270 comp rx=0 tx=0).stop 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 shutdown_connections 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f42080a2c10 0x7f42080a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106a80 0x7f42201a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101420 0x7f4220199780 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 --2- 172.21.15.100:0/4059517915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4220100a80 0x7f4220199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:14.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 >> 172.21.15.100:0/4059517915 conn(0x7f42200fc7a0 msgr2=0x7f42200fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:14.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 shutdown_connections 2024-09-12T02:06:14.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:14.579+0000 7f4225b48640 1 -- 172.21.15.100:0/4059517915 wait complete. 2024-09-12T02:06:15.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:06:15.487 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:15.506 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:15 smithi100 ceph-mon[31179]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:15.507 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:15 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4059517915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:15 smithi189 ceph-mon[35188]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:15 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/4059517915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:15.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:15 smithi117 ceph-mon[35240]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:15.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:15 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/4059517915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:15.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 -- 172.21.15.100:0/2308212360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc101e10 msgr2=0x7fafdc1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:15.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 --2- 172.21.15.100:0/2308212360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc101e10 0x7fafdc1021f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009900 tx=0x7fafd802a410 comp rx=0 tx=0).stop 2024-09-12T02:06:15.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 -- 172.21.15.100:0/2308212360 shutdown_connections 2024-09-12T02:06:15.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 --2- 172.21.15.100:0/2308212360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafdc106f40 0x7fafdc10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 --2- 172.21.15.100:0/2308212360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafdc1027c0 0x7fafdc106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 --2- 172.21.15.100:0/2308212360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc101e10 0x7fafdc1021f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 -- 172.21.15.100:0/2308212360 >> 172.21.15.100:0/2308212360 conn(0x7fafdc0fd8d0 msgr2=0x7fafdc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 -- 172.21.15.100:0/2308212360 shutdown_connections 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.928+0000 7fafe360b640 1 -- 172.21.15.100:0/2308212360 wait complete. 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 Processor -- start 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 -- start start 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafdc101e10 0x7fafdc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafdc1027c0 0x7fafdc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc106f40 0x7fafdc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc111fa0 con 0x7fafdc106f40 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc111e20 con 0x7fafdc101e10 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe360b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc112120 con 0x7fafdc1027c0 2024-09-12T02:06:15.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe1ba8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc106f40 0x7fafdc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe1ba8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc106f40 0x7fafdc19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57080/0 (socket says 172.21.15.100:57080) 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe1ba8640 1 -- 172.21.15.100:0/432116628 learned_addr learned my addr 172.21.15.100:0/432116628 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.929+0000 7fafe0ba6640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafdc1027c0 0x7fafdc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe13a7640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafdc101e10 0x7fafdc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe1ba8640 1 -- 172.21.15.100:0/432116628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafdc1027c0 msgr2=0x7fafdc1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe1ba8640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafdc1027c0 0x7fafdc1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe1ba8640 1 -- 172.21.15.100:0/432116628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafdc101e10 msgr2=0x7fafdc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe1ba8640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafdc101e10 0x7fafdc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe1ba8640 1 -- 172.21.15.100:0/432116628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc19d410 con 0x7fafdc106f40 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe13a7640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafdc101e10 0x7fafdc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe1ba8640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc106f40 0x7fafdc19cd30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafd400eb10 tx=0x7fafd400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafd27fc640 1 -- 172.21.15.100:0/432116628 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd4004b20 con 0x7fafdc106f40 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafdc19d700 con 0x7fafdc106f40 2024-09-12T02:06:15.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafd27fc640 1 -- 172.21.15.100:0/432116628 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafd4004cc0 con 0x7fafdc106f40 2024-09-12T02:06:15.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafd27fc640 1 -- 172.21.15.100:0/432116628 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd4010760 con 0x7fafdc106f40 2024-09-12T02:06:15.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.930+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafdc1a4fe0 con 0x7fafdc106f40 2024-09-12T02:06:15.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.931+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafdc1021f0 con 0x7fafdc106f40 2024-09-12T02:06:15.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.932+0000 7fafd27fc640 1 -- 172.21.15.100:0/432116628 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fafd4005020 con 0x7fafdc106f40 2024-09-12T02:06:15.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.933+0000 7fafd27fc640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fafc80a2c10 0x7fafc80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.933+0000 7fafe13a7640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fafc80a2c10 0x7fafc80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.933+0000 7fafd27fc640 1 -- 172.21.15.100:0/432116628 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fafd40cf8a0 con 0x7fafdc106f40 2024-09-12T02:06:15.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.933+0000 7fafe13a7640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fafc80a2c10 0x7fafc80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafd8000c00 tx=0x7fafd8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:15.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:15.937+0000 7fafd27fc640 1 -- 172.21.15.100:0/432116628 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafd409c6b0 con 0x7fafdc106f40 2024-09-12T02:06:16.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.134+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafdc109b90 con 0x7fafdc106f40 2024-09-12T02:06:16.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.136+0000 7fafd27fc640 1 -- 172.21.15.100:0/432116628 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7fafd407ae20 con 0x7fafdc106f40 2024-09-12T02:06:16.136 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:16.136 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:16.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fafc80a2c10 msgr2=0x7fafc80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:16.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fafc80a2c10 0x7fafc80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafd8000c00 tx=0x7fafd8032c70 comp rx=0 tx=0).stop 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc106f40 msgr2=0x7fafdc19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc106f40 0x7fafdc19cd30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafd400eb10 tx=0x7fafd400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 shutdown_connections 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fafc80a2c10 0x7fafc80a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafdc106f40 0x7fafdc19cd30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fafdc1027c0 0x7fafdc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 --2- 172.21.15.100:0/432116628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafdc101e10 0x7fafdc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 >> 172.21.15.100:0/432116628 conn(0x7fafdc0fd8d0 msgr2=0x7fafdc0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 shutdown_connections 2024-09-12T02:06:16.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:16.138+0000 7fafe360b640 1 -- 172.21.15.100:0/432116628 wait complete. 2024-09-12T02:06:16.516 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:16 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/432116628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:16.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:16 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/432116628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:16 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/432116628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:16.685 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:06:16.934 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:17.311 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:17 smithi100 ceph-mon[31179]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:17.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 -- 172.21.15.100:0/2499439926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 msgr2=0x7f7f54107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 --2- 172.21.15.100:0/2499439926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f54107bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009930 tx=0x7f7f4802a420 comp rx=0 tx=0).stop 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 -- 172.21.15.100:0/2499439926 shutdown_connections 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 --2- 172.21.15.100:0/2499439926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f54108300 0x7f7f5410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 --2- 172.21.15.100:0/2499439926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f54107bc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 --2- 172.21.15.100:0/2499439926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102dd0 0x7f7f541031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 -- 172.21.15.100:0/2499439926 >> 172.21.15.100:0/2499439926 conn(0x7f7f540fc7d0 msgr2=0x7f7f540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 -- 172.21.15.100:0/2499439926 shutdown_connections 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.391+0000 7f7f591fe640 1 -- 172.21.15.100:0/2499439926 wait complete. 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 Processor -- start 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 -- start start 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f54102dd0 0x7f7f541a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f541a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54108300 0x7f7f5419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f541120d0 con 0x7f7f54103780 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54111f50 con 0x7f7f54108300 2024-09-12T02:06:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.392+0000 7f7f591fe640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54112250 con 0x7f7f54102dd0 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f541a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f541a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57106/0 (socket says 172.21.15.100:57106) 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 -- 172.21.15.100:0/3333630842 learned_addr learned my addr 172.21.15.100:0/3333630842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5359e640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54108300 0x7f7f5419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 -- 172.21.15.100:0/3333630842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f54102dd0 msgr2=0x7f7f541a0570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f54102dd0 0x7f7f541a0570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 -- 172.21.15.100:0/3333630842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54108300 msgr2=0x7f7f5419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54108300 0x7f7f5419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 -- 172.21.15.100:0/3333630842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5419aeb0 con 0x7f7f54103780 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5359e640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54108300 0x7f7f5419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f5259c640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f541a0ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005940 tx=0x7f7f480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f3bfff640 1 -- 172.21.15.100:0/3333630842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4803f030 con 0x7f7f54103780 2024-09-12T02:06:17.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5419b140 con 0x7f7f54103780 2024-09-12T02:06:17.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f3bfff640 1 -- 172.21.15.100:0/3333630842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f48003ce0 con 0x7f7f54103780 2024-09-12T02:06:17.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f3bfff640 1 -- 172.21.15.100:0/3333630842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48035070 con 0x7f7f54103780 2024-09-12T02:06:17.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.393+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f541a7320 con 0x7f7f54103780 2024-09-12T02:06:17.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.394+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5406a7b0 con 0x7f7f54103780 2024-09-12T02:06:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.396+0000 7f7f3bfff640 1 -- 172.21.15.100:0/3333630842 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7f48042030 con 0x7f7f54103780 2024-09-12T02:06:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.396+0000 7f7f3bfff640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f3c0a2c10 0x7f7f3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.397+0000 7f7f52d9d640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f3c0a2c10 0x7f7f3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.397+0000 7f7f3bfff640 1 -- 172.21.15.100:0/3333630842 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f480ef9d0 con 0x7f7f54103780 2024-09-12T02:06:17.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.397+0000 7f7f52d9d640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f3c0a2c10 0x7f7f3c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400b9b0 tx=0x7f7f4400b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:17.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.400+0000 7f7f3bfff640 1 -- 172.21.15.100:0/3333630842 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f480bc7e0 con 0x7f7f54103780 2024-09-12T02:06:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:17 smithi189 ceph-mon[35188]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.601+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f541031b0 con 0x7f7f54103780 2024-09-12T02:06:17.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.601+0000 7f7f3bfff640 1 -- 172.21.15.100:0/3333630842 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11929 (secure 0 0 0) 0x7f7f541031b0 con 0x7f7f54103780 2024-09-12T02:06:17.602 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:17.602 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"btime":"2024-09-12T02:05:19:082439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:05:18.350451+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24433,24428]},"id":1}]} 2024-09-12T02:06:17.602 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.603+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f3c0a2c10 msgr2=0x7f7f3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.603+0000 7f7f591fe640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f3c0a2c10 0x7f7f3c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400b9b0 tx=0x7f7f4400b370 comp rx=0 tx=0).stop 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.603+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 msgr2=0x7f7f541a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.603+0000 7f7f591fe640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f541a0ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005940 tx=0x7f7f480042f0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 shutdown_connections 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f3c0a2c10 0x7f7f3c0a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54108300 0x7f7f5419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f54103780 0x7f7f541a0ab0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 --2- 172.21.15.100:0/3333630842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f54102dd0 0x7f7f541a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 >> 172.21.15.100:0/3333630842 conn(0x7f7f540fc7d0 msgr2=0x7f7f54101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 shutdown_connections 2024-09-12T02:06:17.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:17.604+0000 7f7f591fe640 1 -- 172.21.15.100:0/3333630842 wait complete. 2024-09-12T02:06:17.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:17 smithi117 ceph-mon[35240]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:18.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:05:07.550581+0000', 'modified': '2024-09-12T02:05:18.350451+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24452, 'mds_1': 24433, 'mds_2': 24428}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24410': {'gid': 24410, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3915021752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3915021752}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3915021752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/2566860695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 2566860695}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 2566860695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/3569067822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 3569067822}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 3569067822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.117:6837/137176693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 137176693}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 137176693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/2548139728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2548139728}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2548139728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6839/3211661343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 3211661343}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 3211661343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24452, 'qdb_cluster': [24452, 24433, 24428]} 2024-09-12T02:06:18.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:06:18.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:06:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:18.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:18 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3333630842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:18.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:18 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3333630842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:18.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:18 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3333630842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 -- 172.21.15.100:0/1060805477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50102790 msgr2=0x7f6b501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 --2- 172.21.15.100:0/1060805477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50102790 0x7f6b501067e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009900 tx=0x7f6b3802a410 comp rx=0 tx=0).stop 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 -- 172.21.15.100:0/1060805477 shutdown_connections 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 --2- 172.21.15.100:0/1060805477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50106f10 0x7f6b5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 --2- 172.21.15.100:0/1060805477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50102790 0x7f6b501067e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 --2- 172.21.15.100:0/1060805477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b50101de0 0x7f6b501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 -- 172.21.15.100:0/1060805477 >> 172.21.15.100:0/1060805477 conn(0x7f6b500fd8c0 msgr2=0x7f6b500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 -- 172.21.15.100:0/1060805477 shutdown_connections 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 -- 172.21.15.100:0/1060805477 wait complete. 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 Processor -- start 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.866+0000 7f6b55f08640 1 -- start start 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b55f08640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50101de0 0x7f6b5019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b55f08640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b50102790 0x7f6b5019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b55f08640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50106f10 0x7f6b5019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b55f08640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50111f90 con 0x7f6b50101de0 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b55f08640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50111e10 con 0x7f6b50102790 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b55f08640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50112110 con 0x7f6b50106f10 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50101de0 0x7f6b5019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50101de0 0x7f6b5019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57124/0 (socket says 172.21.15.100:57124) 2024-09-12T02:06:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/884702543 learned_addr learned my addr 172.21.15.100:0/884702543 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b50102790 0x7f6b5019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4ffff640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50106f10 0x7f6b5019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/884702543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50106f10 msgr2=0x7f6b5019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50106f10 0x7f6b5019f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/884702543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b50102790 msgr2=0x7f6b5019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b50102790 0x7f6b5019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/884702543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5019f700 con 0x7f6b50101de0 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4ffff640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50106f10 0x7f6b5019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50101de0 0x7f6b5019a750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b4a0 tx=0x7f6b4000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4d7fa640 1 -- 172.21.15.100:0/884702543 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40014070 con 0x7f6b50101de0 2024-09-12T02:06:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5019f9f0 con 0x7f6b50101de0 2024-09-12T02:06:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.867+0000 7f6b4d7fa640 1 -- 172.21.15.100:0/884702543 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b40010af0 con 0x7f6b50101de0 2024-09-12T02:06:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.868+0000 7f6b4d7fa640 1 -- 172.21.15.100:0/884702543 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40017d10 con 0x7f6b50101de0 2024-09-12T02:06:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.868+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a72d0 con 0x7f6b50101de0 2024-09-12T02:06:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.870+0000 7f6b4d7fa640 1 -- 172.21.15.100:0/884702543 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6b40017070 con 0x7f6b50101de0 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b4d7fa640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b3c0a2c10 0x7f6b3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 Processor -- start 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b3c0a2c10 0x7f6b3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b4d7fa640 1 -- 172.21.15.100:0/884702543 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6b400ce480 con 0x7f6b50101de0 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 -- start start 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cd6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4cec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fec4c3d090 con 0x55fec4cd7210 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fec4be4a70 con 0x55fec4cd68f0 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b582e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fec4c39050 con 0x55fec4cea3c0 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57138/0 (socket says 172.21.15.100:57138) 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.871+0000 7f6b46ffd640 1 -- 172.21.15.100:0/38003280 learned_addr learned my addr 172.21.15.100:0/38003280 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b3c0a2c10 0x7f6b3c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b38000c00 tx=0x7f6b380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cd6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b4ffff640 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4cec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b46ffd640 1 -- 172.21.15.100:0/38003280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 msgr2=0x55fec4cec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4cec7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b46ffd640 1 -- 172.21.15.100:0/38003280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 msgr2=0x55fec4cd6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cd6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b46ffd640 1 -- 172.21.15.100:0/38003280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec4bf1130 con 0x55fec4cd7210 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce9e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b38033000 tx=0x7f6b3803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c194e9bb2a8799 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b45ffb640 1 -- 172.21.15.100:0/38003280 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3804d070 con 0x55fec4cd7210 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b45ffb640 1 -- 172.21.15.100:0/38003280 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b38004480 con 0x55fec4cd7210 2024-09-12T02:06:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.872+0000 7f6b45ffb640 1 -- 172.21.15.100:0/38003280 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38035040 con 0x55fec4cd7210 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 -- 172.21.15.100:0/38003280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 msgr2=0x55fec4ce9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce9e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b38033000 tx=0x7f6b3803d000 comp rx=0 tx=0).stop 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 -- 172.21.15.100:0/38003280 shutdown_connections 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4cec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce9e80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 --2- 172.21.15.100:0/38003280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cd6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 -- 172.21.15.100:0/38003280 >> 172.21.15.100:0/38003280 conn(0x55fec4cd2f60 msgr2=0x55fec4cd3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 -- 172.21.15.100:0/38003280 shutdown_connections 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 -- 172.21.15.100:0/38003280 wait complete. 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.873+0000 7f6b582e1740 1 -- start start 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 1 Processor -- start 2024-09-12T02:06:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cd68f0 0x55fec4ce9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cea3c0 0x55fec4ce7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fec4ceced0 con 0x55fec4cd7210 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fec4bf7f20 con 0x55fec4cea3c0 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fec4ced050 con 0x55fec4cd68f0 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b582e1740 10 client.0 _ll_register_callbacks cb 0x55fec4bc1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57150/0 (socket says 172.21.15.100:57150) 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2400151042 learned_addr learned my addr 172.21.15.100:0/2400151042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cd68f0 0x55fec4ce9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2400151042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cd68f0 msgr2=0x55fec4ce9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b4ffff640 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cea3c0 0x55fec4ce7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cd68f0 0x55fec4ce9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cea3c0 msgr2=0x55fec4ce7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cea3c0 0x55fec4ce7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.874+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2400151042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fec49ae2b0 con 0x55fec4cd7210 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce7030 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b38004650 tx=0x7f6b38049bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505712ed47dc5a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b2effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b2effd640 1 -- 172.21.15.100:0/2400151042 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3805a020 con 0x55fec4cd7210 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b2effd640 1 -- 172.21.15.100:0/2400151042 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6b380035f0 con 0x55fec4cd7210 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b38004480 con 0x55fec4cd7210 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b2effd640 1 -- 172.21.15.100:0/2400151042 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6b3804d070 con 0x55fec4cd7210 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 10 client.14964 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55fec4cf8890 con 0x55fec4cd7210 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b2effd640 1 -- 172.21.15.100:0/2400151042 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b38004480 con 0x55fec4cd7210 2024-09-12T02:06:18.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b2effd640 1 -- 172.21.15.100:0/2400151042 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6b38052a90 con 0x55fec4cd7210 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 10 client.14964 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 10 client.14964 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 20 client.14964 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4cf9be0 0x55fec4cfbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 4 client.14964 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.875+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fec4c4a600 con 0x55fec4cf9be0 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.876+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4cf9be0 0x55fec4cfbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.876+0000 7f6b2effd640 10 client.14964 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.876+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4cf9be0 0x55fec4cfbda0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fee22763678b24d8 server_cookie=2123ad3455f25252 in_seq=0 out_seq=0 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b2effd640 1 -- 172.21.15.100:0/2400151042 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fec4c4a600 con 0x55fec4cf9be0 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b2effd640 10 client.14964 handle_command_reply: tid=0 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 client.14964 shutdown 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 msgr2=0x55fec4ce7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce7030 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b38004650 tx=0x7f6b38049bf0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 shutdown_connections 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4cf9be0 0x55fec4cfbda0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cea3c0 0x55fec4ce7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4ce7030 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2400151042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cd68f0 0x55fec4ce9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b2effd640 0 client.14964 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 >> 172.21.15.100:0/2400151042 conn(0x55fec4cd2f60 msgr2=0x55fec4cd8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 shutdown_connections 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 1 -- 172.21.15.100:0/2400151042 wait complete. 2024-09-12T02:06:18.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.877+0000 7f6b582e1740 20 client.14964 trim_cache size 0 max 16384 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 Processor -- start 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 -- start start 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd68f0 0x55fec4cfa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd7210 0x55fec4cfb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4ce2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fec4cfa0e0 con 0x55fec4cd68f0 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fec4cfa7b0 con 0x55fec4cd7210 2024-09-12T02:06:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b582e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fec4cfae80 con 0x55fec4cea3c0 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd68f0 0x55fec4cfa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd68f0 0x55fec4cfa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57154/0 (socket says 172.21.15.100:57154) 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/1779577220 learned_addr learned my addr 172.21.15.100:0/1779577220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd7210 0x55fec4cfb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4ffff640 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4ce2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/1779577220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 msgr2=0x55fec4ce2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4ce2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/1779577220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd7210 msgr2=0x55fec4cfb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd7210 0x55fec4cfb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 -- 172.21.15.100:0/1779577220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fec4ced040 con 0x55fec4cd68f0 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4ffff640 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4ce2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd68f0 0x55fec4cfa260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6b40097100 tx=0x7f6b40017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568352e5b56307d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b457fa640 1 -- 172.21.15.100:0/1779577220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4001e040 con 0x55fec4cd68f0 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.895+0000 7f6b457fa640 1 -- 172.21.15.100:0/1779577220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b40098d40 con 0x55fec4cd68f0 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b457fa640 1 -- 172.21.15.100:0/1779577220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40010ca0 con 0x55fec4cd68f0 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 -- 172.21.15.100:0/1779577220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd68f0 msgr2=0x55fec4cfa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd68f0 0x55fec4cfa260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6b40097100 tx=0x7f6b40017730 comp rx=0 tx=0).stop 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 -- 172.21.15.100:0/1779577220 shutdown_connections 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4ce2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd7210 0x55fec4cfb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 --2- 172.21.15.100:0/1779577220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd68f0 0x55fec4cfa260 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 -- 172.21.15.100:0/1779577220 >> 172.21.15.100:0/1779577220 conn(0x55fec4cd2f60 msgr2=0x55fec4cd3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 -- 172.21.15.100:0/1779577220 shutdown_connections 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.896+0000 7f6b582e1740 1 -- 172.21.15.100:0/1779577220 wait complete. 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 -- start start 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 Processor -- start 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cfd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4cfda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4d63030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fec4cfbc20 con 0x55fec4cd7210 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fec4cfb550 con 0x55fec4cd68f0 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fec4cfc2f0 con 0x55fec4cea3c0 2024-09-12T02:06:18.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b582e1740 10 client.0 _ll_register_callbacks cb 0x7f6b38031a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4cfda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4cfda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57160/0 (socket says 172.21.15.100:57160) 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2269191108 learned_addr learned my addr 172.21.15.100:0/2269191108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cfd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2269191108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 msgr2=0x55fec4d63030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4d63030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 msgr2=0x55fec4cfd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cfd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.897+0000 7f6b46ffd640 1 -- 172.21.15.100:0/2269191108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fec4d63570 con 0x55fec4cd7210 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b46ffd640 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4cfda40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6b38006010 tx=0x7f6b38004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d6f7e4c8ff4227 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b2effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b2effd640 1 -- 172.21.15.100:0/2269191108 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38040040 con 0x55fec4cd7210 2024-09-12T02:06:18.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b2effd640 1 -- 172.21.15.100:0/2269191108 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6b38049660 con 0x55fec4cd7210 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b40098d40 con 0x55fec4cd7210 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b2effd640 1 -- 172.21.15.100:0/2269191108 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6b3805a040 con 0x55fec4cd7210 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 10 client.14970 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55fec4d647e0 con 0x55fec4cd7210 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b2effd640 1 -- 172.21.15.100:0/2269191108 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b40098d40 con 0x55fec4cd7210 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b2effd640 1 -- 172.21.15.100:0/2269191108 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6b38052450 con 0x55fec4cd7210 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 10 client.14970 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 10 client.14970 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 20 client.14970 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4d69180 0x55fec4d67e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 4 client.14970 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:18.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.898+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "status"}) -- 0x55fec4c44b10 con 0x55fec4d69180 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4d69180 0x55fec4d67e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b2effd640 10 client.14970 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b4f7fe640 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4d69180 0x55fec4d67e90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=163bc96985598d74 server_cookie=d98abd8fe11eeb42 in_seq=0 out_seq=0 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b2effd640 1 -- 172.21.15.100:0/2269191108 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fec4c44b10 con 0x55fec4d69180 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b2effd640 10 client.14970 handle_command_reply: tid=0 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 client.14970 shutdown 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 msgr2=0x55fec4cfda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4cfda40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6b38006010 tx=0x7f6b38004530 comp rx=0 tx=0).stop 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 shutdown_connections 2024-09-12T02:06:18.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55fec4d69180 0x55fec4d67e90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fec4cea3c0 0x55fec4d63030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fec4cd7210 0x55fec4cfda40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 --2- 172.21.15.100:0/2269191108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fec4cd68f0 0x55fec4cfd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 >> 172.21.15.100:0/2269191108 conn(0x55fec4cd2f60 msgr2=0x55fec4ce2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b2effd640 0 client.14970 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.899+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 shutdown_connections 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b582e1740 1 -- 172.21.15.100:0/2269191108 wait complete. 2024-09-12T02:06:18.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b582e1740 20 client.14970 trim_cache size 0 max 16384 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24428, 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 62.815851670000001, 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 23, 2024-09-12T02:06:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:06:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:06:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 93.437899084999998 2024-09-12T02:06:18.909 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b3c0a2c10 msgr2=0x7f6b3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b3c0a2c10 0x7f6b3c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b38000c00 tx=0x7f6b380058d0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50101de0 msgr2=0x7f6b5019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50101de0 0x7f6b5019a750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b4a0 tx=0x7f6b4000b960 comp rx=0 tx=0).stop 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 shutdown_connections 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b3c0a2c10 0x7f6b3c0a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b50106f10 0x7f6b5019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b50102790 0x7f6b5019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 --2- 172.21.15.100:0/884702543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50101de0 0x7f6b5019a750 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 >> 172.21.15.100:0/884702543 conn(0x7f6b500fd8c0 msgr2=0x7f6b500fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 shutdown_connections 2024-09-12T02:06:18.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:18.900+0000 7f6b55f08640 1 -- 172.21.15.100:0/884702543 wait complete. 2024-09-12T02:06:19.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:19 smithi100 ceph-mon[31179]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:19 smithi189 ceph-mon[35188]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:19.608 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:06:19.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:19 smithi117 ceph-mon[35240]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:20.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3277048679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8100e20 msgr2=0x7f0cc8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3277048679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8100e20 0x7f0cc8101200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009ca0 tx=0x7f0cb802a950 comp rx=0 tx=0).stop 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3277048679 shutdown_connections 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3277048679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc8102ef0 0x7f0cc810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3277048679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cc8102570 0x7f0cc81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3277048679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8100e20 0x7f0cc8101200 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3277048679 >> 172.21.15.100:0/3277048679 conn(0x7f0cc80fc7d0 msgr2=0x7f0cc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3277048679 shutdown_connections 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.274+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3277048679 wait complete. 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.275+0000 7f0ccd6ef640 1 Processor -- start 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.275+0000 7f0ccd6ef640 1 -- start start 2024-09-12T02:06:20.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc8100e20 0x7f0cc8199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cc8102570 0x7f0cc81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8102ef0 0x7f0cc81a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8110fa0 con 0x7f0cc8102ef0 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8110e20 con 0x7f0cc8100e20 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8111120 con 0x7f0cc8102570 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8102ef0 0x7f0cc81a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8102ef0 0x7f0cc81a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57184/0 (socket says 172.21.15.100:57184) 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 -- 172.21.15.100:0/3603020269 learned_addr learned my addr 172.21.15.100:0/3603020269 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc8100e20 0x7f0cc8199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 -- 172.21.15.100:0/3603020269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cc8102570 msgr2=0x7f0cc81998b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cc8102570 0x7f0cc81998b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 -- 172.21.15.100:0/3603020269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc8100e20 msgr2=0x7f0cc8199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc8100e20 0x7f0cc8199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 -- 172.21.15.100:0/3603020269 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc81a4930 con 0x7f0cc8102ef0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0cc77fe640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8102ef0 0x7f0cc81a43f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c970 tx=0x7f0cc000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0caffff640 1 -- 172.21.15.100:0/3603020269 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0007bb0 con 0x7f0cc8102ef0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc81a4b00 con 0x7f0cc8102ef0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0caffff640 1 -- 172.21.15.100:0/3603020269 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cc0007d50 con 0x7f0cc8102ef0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0caffff640 1 -- 172.21.15.100:0/3603020269 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0018800 con 0x7f0cc8102ef0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.276+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc81a4fc0 con 0x7f0cc8102ef0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0caffff640 1 -- 172.21.15.100:0/3603020269 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0cc000fa50 con 0x7f0cc8102ef0 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 Processor -- start 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 -- start start 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 0x55cab344edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344f2f0 0x55cab3459670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab3459bb0 0x55cab345bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cab33b5090 con 0x55cab344f2f0 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cab335ca70 con 0x55cab3459bb0 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cab33b1050 con 0x55cab344e9d0 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0cc6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344f2f0 0x55cab3459670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0cc6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344f2f0 0x55cab3459670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57198/0 (socket says 172.21.15.100:57198) 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.279+0000 7f0cc6ffd640 1 -- 172.21.15.100:0/3885125719 learned_addr learned my addr 172.21.15.100:0/3885125719 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 0x55cab344edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0caffff640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cb00a2c10 0x7f0cb00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab3459bb0 0x55cab345bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc6ffd640 1 -- 172.21.15.100:0/3885125719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 msgr2=0x55cab344edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 0x55cab344edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc6ffd640 1 -- 172.21.15.100:0/3885125719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab3459bb0 msgr2=0x55cab345bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab3459bb0 0x55cab345bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc6ffd640 1 -- 172.21.15.100:0/3885125719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cab3369130 con 0x55cab344f2f0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc77fe640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cb00a2c10 0x7f0cb00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344f2f0 0x55cab3459670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8035000 tx=0x7f0cb802f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb314c0c762dc207 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0caffff640 1 -- 172.21.15.100:0/3603020269 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0cc00cf200 con 0x7f0cc8102ef0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cad7fa640 1 -- 172.21.15.100:0/3885125719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8048070 con 0x55cab344f2f0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cad7fa640 1 -- 172.21.15.100:0/3885125719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cb802fb90 con 0x55cab344f2f0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.280+0000 7f0cad7fa640 1 -- 172.21.15.100:0/3885125719 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8034040 con 0x55cab344f2f0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3885125719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344f2f0 msgr2=0x55cab3459670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0cc77fe640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cb00a2c10 0x7f0cb00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0cc009b8a0 tx=0x7f0cc006d920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344f2f0 0x55cab3459670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8035000 tx=0x7f0cb802f930 comp rx=0 tx=0).stop 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3885125719 shutdown_connections 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab3459bb0 0x55cab345bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344f2f0 0x55cab3459670 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3885125719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 0x55cab344edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3885125719 >> 172.21.15.100:0/3885125719 conn(0x55cab344af60 msgr2=0x55cab344b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3885125719 shutdown_connections 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3885125719 wait complete. 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 -- start start 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.281+0000 7f0ccfac8740 1 Processor -- start 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab3459420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 0x55cab3456cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cab345c780 con 0x55cab344e9d0 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cab336ff20 con 0x55cab344f2f0 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cab345c900 con 0x55cab3459bb0 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab3459420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 10 client.0 _ll_register_callbacks cb 0x55cab3339030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:20.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab3459420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57208/0 (socket says 172.21.15.100:57208) 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 -- 172.21.15.100:0/3020197722 learned_addr learned my addr 172.21.15.100:0/3020197722 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 -- 172.21.15.100:0/3020197722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 msgr2=0x55cab3456cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 0x55cab3456cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 -- 172.21.15.100:0/3020197722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 msgr2=0x55cab3456770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 -- 172.21.15.100:0/3020197722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cab31262b0 con 0x55cab344e9d0 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab3459420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc005d80 tx=0x7f0cbc001500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2680518cce3d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0caaff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0caaff5640 1 -- 172.21.15.100:0/3020197722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc012040 con 0x55cab344e9d0 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cb802fb90 con 0x55cab344e9d0 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0caaff5640 1 -- 172.21.15.100:0/3020197722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0cbc0163f0 con 0x55cab344e9d0 2024-09-12T02:06:20.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0caaff5640 1 -- 172.21.15.100:0/3020197722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0cbc0165f0 con 0x55cab344e9d0 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 10 client.14982 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.282+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55cab3468100 con 0x55cab344e9d0 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0caaff5640 1 -- 172.21.15.100:0/3020197722 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cb802fb90 con 0x55cab344e9d0 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0caaff5640 1 -- 172.21.15.100:0/3020197722 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0cbc015070 con 0x55cab344e9d0 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0ccfac8740 10 client.14982 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0ccfac8740 10 client.14982 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0ccfac8740 20 client.14982 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab346a740 0x55cab346bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0ccfac8740 4 client.14982 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cab33c2600 con 0x55cab346a740 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.283+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab346a740 0x55cab346bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.284+0000 7f0caaff5640 10 client.14982 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.284+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab346a740 0x55cab346bbb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e03bffa7852fdf0 server_cookie=5c7bb89b0b3c1344 in_seq=0 out_seq=0 2024-09-12T02:06:20.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.284+0000 7f0caaff5640 1 -- 172.21.15.100:0/3020197722 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cab33c2600 con 0x55cab346a740 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.284+0000 7f0caaff5640 10 client.14982 handle_command_reply: tid=0 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.284+0000 7f0ccfac8740 1 client.14982 shutdown 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 msgr2=0x55cab3459420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab3459420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc005d80 tx=0x7f0cbc001500 comp rx=0 tx=0).stop 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 shutdown_connections 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab346a740 0x55cab346bbb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 0x55cab3456cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0caaff5640 0 client.14982 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/3020197722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab3459420 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 >> 172.21.15.100:0/3020197722 conn(0x55cab344af60 msgr2=0x55cab3450c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 shutdown_connections 2024-09-12T02:06:20.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 1 -- 172.21.15.100:0/3020197722 wait complete. 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.285+0000 7f0ccfac8740 20 client.14982 trim_cache size 0 max 16384 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.303+0000 7f0ccfac8740 1 Processor -- start 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.303+0000 7f0ccfac8740 1 -- start start 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab346bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 0x55cab3456c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cab3469ef0 con 0x55cab344e9d0 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cab346a5c0 con 0x55cab344f2f0 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cab346ac90 con 0x55cab3459bb0 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab346bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab346bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57210/0 (socket says 172.21.15.100:57210) 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 -- 172.21.15.100:0/1197650408 learned_addr learned my addr 172.21.15.100:0/1197650408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:20.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 -- 172.21.15.100:0/1197650408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 msgr2=0x55cab3456c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 0x55cab3456c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 -- 172.21.15.100:0/1197650408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 msgr2=0x55cab3456730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 -- 172.21.15.100:0/1197650408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cab3457290 con 0x55cab344e9d0 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab346bbb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000ee0 tx=0x7f0cbc009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676115060fd3d805 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.304+0000 7f0cacff9640 1 -- 172.21.15.100:0/1197650408 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc02f070 con 0x55cab344e9d0 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0cacff9640 1 -- 172.21.15.100:0/1197650408 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cbc01eb30 con 0x55cab344e9d0 2024-09-12T02:06:20.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0cacff9640 1 -- 172.21.15.100:0/1197650408 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc02a440 con 0x55cab344e9d0 2024-09-12T02:06:20.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 -- 172.21.15.100:0/1197650408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 msgr2=0x55cab346bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab346bbb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000ee0 tx=0x7f0cbc009d70 comp rx=0 tx=0).stop 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 -- 172.21.15.100:0/1197650408 shutdown_connections 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab3459bb0 0x55cab3456c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab3456730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/1197650408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab344e9d0 0x55cab346bbb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 -- 172.21.15.100:0/1197650408 >> 172.21.15.100:0/1197650408 conn(0x55cab344af60 msgr2=0x55cab344b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 -- 172.21.15.100:0/1197650408 shutdown_connections 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.305+0000 7f0ccfac8740 1 -- 172.21.15.100:0/1197650408 wait complete. 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 -- start start 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 Processor -- start 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 0x55cab346efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab346f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab3459bb0 0x55cab34d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cab346ba30 con 0x55cab3459bb0 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cab346b360 con 0x55cab344f2f0 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cab346c100 con 0x55cab344e9d0 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0ccfac8740 10 client.0 _ll_register_callbacks cb 0x7f0cbc007050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0cc67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab3459bb0 0x55cab34d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0cc67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab3459bb0 0x55cab34d2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57222/0 (socket says 172.21.15.100:57222) 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0cc67fc640 1 -- 172.21.15.100:0/2761646685 learned_addr learned my addr 172.21.15.100:0/2761646685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.306+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab346f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0cc67fc640 1 -- 172.21.15.100:0/2761646685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 msgr2=0x55cab346efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 0x55cab346efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0cc67fc640 1 -- 172.21.15.100:0/2761646685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 msgr2=0x55cab346f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab346f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0cc67fc640 1 -- 172.21.15.100:0/2761646685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cab34d3380 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0cc67fc640 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab3459bb0 0x55cab34d2e40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000f30 tx=0x7f0cbc000fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafa5f6c8b36d76f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0caaff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0caaff5640 1 -- 172.21.15.100:0/2761646685 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc02f040 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0caaff5640 1 -- 172.21.15.100:0/2761646685 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0cbc001c10 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cbc01eb30 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0caaff5640 1 -- 172.21.15.100:0/2761646685 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0cbc001a00 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0ccfac8740 10 client.14988 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55cab34d4500 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.307+0000 7f0caaff5640 1 -- 172.21.15.100:0/2761646685 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cbc01eb30 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0caaff5640 1 -- 172.21.15.100:0/2761646685 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0cbc015040 con 0x55cab3459bb0 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0ccfac8740 10 client.14988 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0ccfac8740 10 client.14988 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:06:20.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0ccfac8740 20 client.14988 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab34d8e40 0x55cab34d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0ccfac8740 4 client.14988 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "status"}) -- 0x55cab33bcb10 con 0x55cab34d8e40 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab34d8e40 0x55cab34d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0caaff5640 10 client.14988 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.308+0000 7f0cc6ffd640 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab34d8e40 0x55cab34d7b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2560ef006852bfa3 server_cookie=2305794f6ca9250e in_seq=0 out_seq=0 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0caaff5640 1 -- 172.21.15.100:0/2761646685 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55cab33bcb10 con 0x55cab34d8e40 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0caaff5640 10 client.14988 handle_command_reply: tid=0 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 client.14988 shutdown 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab3459bb0 msgr2=0x55cab34d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab3459bb0 0x55cab34d2e40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000f30 tx=0x7f0cbc000fd0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 shutdown_connections 2024-09-12T02:06:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cab3459bb0 0x55cab34d2e40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cab344f2f0 0x55cab346f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55cab34d8e40 0x55cab34d7b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 --2- 172.21.15.100:0/2761646685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cab344e9d0 0x55cab346efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 >> 172.21.15.100:0/2761646685 conn(0x55cab344af60 msgr2=0x55cab3456730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0caaff5640 0 client.14988 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 shutdown_connections 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 1 -- 172.21.15.100:0/2761646685 wait complete. 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.309+0000 7f0ccfac8740 20 client.14988 trim_cache size 0 max 16384 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24433, 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 65.234908227999995, 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 23, 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 92.413379612 2024-09-12T02:06:20.324 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cb00a2c10 msgr2=0x7f0cb00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cb00a2c10 0x7f0cb00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0cc009b8a0 tx=0x7f0cc006d920 comp rx=0 tx=0).stop 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8102ef0 msgr2=0x7f0cc81a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8102ef0 0x7f0cc81a43f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c970 tx=0x7f0cc000ce30 comp rx=0 tx=0).stop 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 shutdown_connections 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0cb00a2c10 0x7f0cb00a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cc8102ef0 0x7f0cc81a43f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cc8102570 0x7f0cc81998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 --2- 172.21.15.100:0/3603020269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc8100e20 0x7f0cc8199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 >> 172.21.15.100:0/3603020269 conn(0x7f0cc80fc7d0 msgr2=0x7f0cc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 shutdown_connections 2024-09-12T02:06:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:20.310+0000 7f0ccd6ef640 1 -- 172.21.15.100:0/3603020269 wait complete. 2024-09-12T02:06:20.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:06:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:21.508 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:21 smithi100 ceph-mon[31179]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 -- 172.21.15.100:0/1961284524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 msgr2=0x7f38ac1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 --2- 172.21.15.100:0/1961284524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1031c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f389c009900 tx=0x7f389c02a480 comp rx=0 tx=0).stop 2024-09-12T02:06:21.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 -- 172.21.15.100:0/1961284524 shutdown_connections 2024-09-12T02:06:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 --2- 172.21.15.100:0/1961284524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38ac10c180 0x7f38ac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 --2- 172.21.15.100:0/1961284524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac103700 0x7f38ac10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 --2- 172.21.15.100:0/1961284524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1031c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 -- 172.21.15.100:0/1961284524 >> 172.21.15.100:0/1961284524 conn(0x7f38ac0fc7a0 msgr2=0x7f38ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 -- 172.21.15.100:0/1961284524 shutdown_connections 2024-09-12T02:06:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.589+0000 7f38b1580640 1 -- 172.21.15.100:0/1961284524 wait complete. 2024-09-12T02:06:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 Processor -- start 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 -- start start 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38ac103700 0x7f38ac1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac10c180 0x7f38ac19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac111fb0 con 0x7f38ac102de0 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac111e30 con 0x7f38ac10c180 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38b1580640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac112130 con 0x7f38ac103700 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57240/0 (socket says 172.21.15.100:57240) 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 -- 172.21.15.100:0/347767238 learned_addr learned my addr 172.21.15.100:0/347767238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac10c180 0x7f38ac19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 -- 172.21.15.100:0/347767238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38ac103700 msgr2=0x7f38ac1989f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38ac103700 0x7f38ac1989f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 -- 172.21.15.100:0/347767238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac10c180 msgr2=0x7f38ac19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac10c180 0x7f38ac19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38aaffd640 1 -- 172.21.15.100:0/347767238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac19d460 con 0x7f38ac102de0 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.590+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac10c180 0x7f38ac19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.591+0000 7f38aaffd640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1984b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f389c006010 tx=0x7f389c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.591+0000 7f38a8ff9640 1 -- 172.21.15.100:0/347767238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c03f030 con 0x7f38ac102de0 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.591+0000 7f38a8ff9640 1 -- 172.21.15.100:0/347767238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f389c003ce0 con 0x7f38ac102de0 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.591+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac19d6f0 con 0x7f38ac102de0 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.591+0000 7f38a8ff9640 1 -- 172.21.15.100:0/347767238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c035070 con 0x7f38ac102de0 2024-09-12T02:06:21.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.591+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac1a5030 con 0x7f38ac102de0 2024-09-12T02:06:21.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:21 smithi189 ceph-mon[35188]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.593+0000 7f38a8ff9640 1 -- 172.21.15.100:0/347767238 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f389c042030 con 0x7f38ac102de0 2024-09-12T02:06:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.593+0000 7f38b3959740 1 Processor -- start 2024-09-12T02:06:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.593+0000 7f38b3959740 1 -- start start 2024-09-12T02:06:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38b3959740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a265db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38b3959740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a270670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38b3959740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a272fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38b3959740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560c2a1cc090 con 0x560c2a2659d0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38b3959740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560c2a173a70 con 0x560c2a270bb0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38b3959740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560c2a1c8050 con 0x560c2a2662f0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a265db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a265db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57252/0 (socket says 172.21.15.100:57252) 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 -- 172.21.15.100:0/1808410832 learned_addr learned my addr 172.21.15.100:0/1808410832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38a8ff9640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f38980a2c90 0x7f38980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38a3fff640 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a272fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f38980a2c90 0x7f38980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38a8ff9640 1 -- 172.21.15.100:0/347767238 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f389c0ef880 con 0x7f38ac102de0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 -- 172.21.15.100:0/1808410832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 msgr2=0x560c2a270670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38aaffd640 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a270670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a270670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 -- 172.21.15.100:0/1808410832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 msgr2=0x560c2a272fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a272fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38ab7fe640 1 -- 172.21.15.100:0/1808410832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c2a180130 con 0x560c2a2659d0 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38a3fff640 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a272fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.594+0000 7f38aaffd640 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a270670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.595+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a265db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38a400cbf0 tx=0x7f38a4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe4f709c29be609 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.595+0000 7f38a17fa640 1 -- 172.21.15.100:0/1808410832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4015070 con 0x560c2a2659d0 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.595+0000 7f38a17fa640 1 -- 172.21.15.100:0/1808410832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a4016040 con 0x560c2a2659d0 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.595+0000 7f38a17fa640 1 -- 172.21.15.100:0/1808410832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a401e020 con 0x560c2a2659d0 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.595+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f38980a2c90 0x7f38980a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38a401f000 tx=0x7f38a401b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 -- 172.21.15.100:0/1808410832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 msgr2=0x560c2a265db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a265db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38a400cbf0 tx=0x7f38a4007680 comp rx=0 tx=0).stop 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 -- 172.21.15.100:0/1808410832 shutdown_connections 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a272fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a270670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 --2- 172.21.15.100:0/1808410832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a265db0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 -- 172.21.15.100:0/1808410832 >> 172.21.15.100:0/1808410832 conn(0x560c2a261f60 msgr2=0x560c2a262340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 -- 172.21.15.100:0/1808410832 shutdown_connections 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 -- 172.21.15.100:0/1808410832 wait complete. 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 -- start start 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 Processor -- start 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a2704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a26d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.596+0000 7f38b3959740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a26dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38b3959740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560c2a273780 con 0x560c2a2659d0 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38b3959740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560c2a186f20 con 0x560c2a270bb0 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38b3959740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560c2a273900 con 0x560c2a2662f0 2024-09-12T02:06:21.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a2704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38b3959740 10 client.0 _ll_register_callbacks cb 0x560c2a150030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a2704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57258/0 (socket says 172.21.15.100:57258) 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 -- 172.21.15.100:0/2282108464 learned_addr learned my addr 172.21.15.100:0/2282108464 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38ab7fe640 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a26dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38a3fff640 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a26d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 -- 172.21.15.100:0/2282108464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 msgr2=0x560c2a26d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a26d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 -- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 msgr2=0x560c2a26dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a26dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 -- 172.21.15.100:0/2282108464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c29f3d2b0 con 0x560c2a2659d0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38aaffd640 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a2704d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f389c005ab0 tx=0x7f389c0b7c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d3969abf3cee00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38927fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38927fc640 1 -- 172.21.15.100:0/2282108464 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c049040 con 0x560c2a2659d0 2024-09-12T02:06:21.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38927fc640 1 -- 172.21.15.100:0/2282108464 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f389c0c47d0 con 0x560c2a2659d0 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a4016040 con 0x560c2a2659d0 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38927fc640 1 -- 172.21.15.100:0/2282108464 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f389c0bb950 con 0x560c2a2659d0 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38b3959740 10 client.15000 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x560c2a283480 con 0x560c2a2659d0 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.597+0000 7f38927fc640 1 -- 172.21.15.100:0/2282108464 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a4016040 con 0x560c2a2659d0 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38927fc640 1 -- 172.21.15.100:0/2282108464 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f389c0dab70 con 0x560c2a2659d0 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38b3959740 10 client.15000 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38b3959740 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38b3959740 20 client.15000 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38b3959740 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a285b40 0x560c2a286fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38b3959740 4 client.15000 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c2a1d9600 con 0x560c2a285b40 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38a3fff640 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a285b40 0x560c2a286fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38927fc640 10 client.15000 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:21.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.598+0000 7f38a3fff640 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a285b40 0x560c2a286fb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5ed7e757e5f65db server_cookie=72cbbea571758a56 in_seq=0 out_seq=0 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38927fc640 1 -- 172.21.15.100:0/2282108464 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c2a1d9600 con 0x560c2a285b40 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38927fc640 10 client.15000 handle_command_reply: tid=0 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 client.15000 shutdown 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 msgr2=0x560c2a2704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a2704d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f389c005ab0 tx=0x7f389c0b7c70 comp rx=0 tx=0).stop 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 shutdown_connections 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a285b40 0x560c2a286fb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a26dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2662f0 0x560c2a26d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 --2- 172.21.15.100:0/2282108464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a2704d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38927fc640 0 client.15000 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.599+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 >> 172.21.15.100:0/2282108464 conn(0x560c2a261f60 msgr2=0x560c2a267c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.600+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 shutdown_connections 2024-09-12T02:06:21.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.600+0000 7f38b3959740 1 -- 172.21.15.100:0/2282108464 wait complete. 2024-09-12T02:06:21.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.600+0000 7f38b3959740 20 client.15000 trim_cache size 0 max 16384 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 Processor -- start 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 -- start start 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2659d0 0x560c2a285470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2662f0 0x560c2a286210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a26f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560c2a2852f0 con 0x560c2a2662f0 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560c2a2859c0 con 0x560c2a270bb0 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38b3959740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560c2a286090 con 0x560c2a2659d0 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2662f0 0x560c2a286210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2662f0 0x560c2a286210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57260/0 (socket says 172.21.15.100:57260) 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.617+0000 7f38a3fff640 1 -- 172.21.15.100:0/4108294808 learned_addr learned my addr 172.21.15.100:0/4108294808 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:21.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a3fff640 1 -- 172.21.15.100:0/4108294808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2659d0 msgr2=0x560c2a285470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a3fff640 1 --2- 172.21.15.100:0/4108294808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2659d0 0x560c2a285470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a3fff640 1 -- 172.21.15.100:0/4108294808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 msgr2=0x560c2a26f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a3fff640 1 --2- 172.21.15.100:0/4108294808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a26f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a3fff640 1 -- 172.21.15.100:0/4108294808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c2a266ee0 con 0x560c2a2662f0 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a3fff640 1 --2- 172.21.15.100:0/4108294808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2662f0 0x560c2a286210 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x560c2a26d0b0 tx=0x7f389400e460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846c1c5019bf7280 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a0ff9640 1 -- 172.21.15.100:0/4108294808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894019310 con 0x560c2a2662f0 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a0ff9640 1 -- 172.21.15.100:0/4108294808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3894019990 con 0x560c2a2662f0 2024-09-12T02:06:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38a0ff9640 1 -- 172.21.15.100:0/4108294808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894011b70 con 0x560c2a2662f0 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38b3959740 1 -- 172.21.15.100:0/4108294808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2662f0 msgr2=0x560c2a286210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.618+0000 7f38b3959740 1 --2- 172.21.15.100:0/4108294808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2662f0 0x560c2a286210 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x560c2a26d0b0 tx=0x7f389400e460 comp rx=0 tx=0).stop 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- 172.21.15.100:0/4108294808 shutdown_connections 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 --2- 172.21.15.100:0/4108294808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a270bb0 0x560c2a26f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 --2- 172.21.15.100:0/4108294808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2662f0 0x560c2a286210 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 --2- 172.21.15.100:0/4108294808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a2659d0 0x560c2a285470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- 172.21.15.100:0/4108294808 >> 172.21.15.100:0/4108294808 conn(0x560c2a261f60 msgr2=0x560c2a26ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- 172.21.15.100:0/4108294808 shutdown_connections 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- 172.21.15.100:0/4108294808 wait complete. 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- start start 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 Processor -- start 2024-09-12T02:06:21.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a28f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a2662f0 0x560c2a28abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a270bb0 0x560c2a28b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560c2a286e30 con 0x560c2a2659d0 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560c2a286760 con 0x560c2a2662f0 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560c2a287500 con 0x560c2a270bb0 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38b3959740 10 client.0 _ll_register_callbacks cb 0x7f389c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a28f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a28f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57270/0 (socket says 172.21.15.100:57270) 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.619+0000 7f38aaffd640 1 -- 172.21.15.100:0/2107405195 learned_addr learned my addr 172.21.15.100:0/2107405195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38a3fff640 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a2662f0 0x560c2a28abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38aaffd640 1 -- 172.21.15.100:0/2107405195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a270bb0 msgr2=0x560c2a28b100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38aaffd640 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a270bb0 0x560c2a28b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38aaffd640 1 -- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a2662f0 msgr2=0x560c2a28abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38aaffd640 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a2662f0 0x560c2a28abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38aaffd640 1 -- 172.21.15.100:0/2107405195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c2a28b7a0 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38aaffd640 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a28f840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f389c0b89c0 tx=0x7f389c0ed1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211869078ecdd7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38927fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38927fc640 1 -- 172.21.15.100:0/2107405195 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c049070 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38927fc640 1 -- 172.21.15.100:0/2107405195 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f389c0b6d60 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3894019990 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38927fc640 1 -- 172.21.15.100:0/2107405195 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f389c03bcb0 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38b3959740 10 client.15006 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x560c2a28b7a0 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38927fc640 1 -- 172.21.15.100:0/2107405195 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3894019990 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38927fc640 1 -- 172.21.15.100:0/2107405195 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f389c0bb440 con 0x560c2a2659d0 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38b3959740 10 client.15006 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:21.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38b3959740 10 client.15006 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38b3959740 20 client.15006 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.620+0000 7f38b3959740 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a2f48d0 0x560c2a2f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 4 client.15006 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "status"}) -- 0x560c2a1d3b10 con 0x560c2a2f48d0 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38a3fff640 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a2f48d0 0x560c2a2f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38927fc640 10 client.15006 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38a3fff640 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a2f48d0 0x560c2a2f35e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966bb76499fdd663 server_cookie=d3a305af190b9b29 in_seq=0 out_seq=0 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38927fc640 1 -- 172.21.15.100:0/2107405195 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560c2a1d3b10 con 0x560c2a2f48d0 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38927fc640 10 client.15006 handle_command_reply: tid=0 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 client.15006 shutdown 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 msgr2=0x560c2a28f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a28f840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f389c0b89c0 tx=0x7f389c0ed1a0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 shutdown_connections 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560c2a2f48d0 0x560c2a2f35e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38927fc640 0 client.15006 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560c2a270bb0 0x560c2a28b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c2a2662f0 0x560c2a28abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.621+0000 7f38b3959740 1 --2- 172.21.15.100:0/2107405195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c2a2659d0 0x560c2a28f840 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 >> 172.21.15.100:0/2107405195 conn(0x560c2a261f60 msgr2=0x560c2a261000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 shutdown_connections 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b3959740 1 -- 172.21.15.100:0/2107405195 wait complete. 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b3959740 20 client.15006 trim_cache size 0 max 16384 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:21.627 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24452, 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 73.579886271000007, 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 23, 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 84.644381323000005 2024-09-12T02:06:21.628 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:21.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f38980a2c90 msgr2=0x7f38980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f38980a2c90 0x7f38980a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38a401f000 tx=0x7f38a401b000 comp rx=0 tx=0).stop 2024-09-12T02:06:21.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 msgr2=0x7f38ac1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:21.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1984b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f389c006010 tx=0x7f389c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 shutdown_connections 2024-09-12T02:06:21.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f38980a2c90 0x7f38980a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac10c180 0x7f38ac19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38ac103700 0x7f38ac1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 --2- 172.21.15.100:0/347767238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38ac102de0 0x7f38ac1984b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 >> 172.21.15.100:0/347767238 conn(0x7f38ac0fc7a0 msgr2=0x7f38ac0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 shutdown_connections 2024-09-12T02:06:21.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:21.622+0000 7f38b1580640 1 -- 172.21.15.100:0/347767238 wait complete. 2024-09-12T02:06:21.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:21 smithi117 ceph-mon[35240]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:22.283 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T02:06:22.283 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:06:22.293 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:06:22.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T02:06:22.540 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:22.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 -- 172.21.15.100:0/2017269161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c102660 msgr2=0x7fd03c104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 --2- 172.21.15.100:0/2017269161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c102660 0x7fd03c104a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009ca0 tx=0x7fd02c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 -- 172.21.15.100:0/2017269161 shutdown_connections 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 --2- 172.21.15.100:0/2017269161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd03c1078c0 0x7fd03c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 --2- 172.21.15.100:0/2017269161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd03c104f90 0x7fd03c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 --2- 172.21.15.100:0/2017269161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c102660 0x7fd03c104a50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 -- 172.21.15.100:0/2017269161 >> 172.21.15.100:0/2017269161 conn(0x7fd03c0fc280 msgr2=0x7fd03c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 -- 172.21.15.100:0/2017269161 shutdown_connections 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.953+0000 7fd0414c5640 1 -- 172.21.15.100:0/2017269161 wait complete. 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.954+0000 7fd0414c5640 1 Processor -- start 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.954+0000 7fd0414c5640 1 -- start start 2024-09-12T02:06:22.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd0414c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd03c102660 0x7fd03c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd0414c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c104f90 0x7fd03c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd0414c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd03c1078c0 0x7fd03c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd0414c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c10d8e0 con 0x7fd03c104f90 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd0414c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c10d760 con 0x7fd03c1078c0 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd0414c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c10da60 con 0x7fd03c102660 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c104f90 0x7fd03c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c104f90 0x7fd03c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57284/0 (socket says 172.21.15.100:57284) 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 -- 172.21.15.100:0/911462291 learned_addr learned my addr 172.21.15.100:0/911462291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03affd640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd03c102660 0x7fd03c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03b7fe640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd03c1078c0 0x7fd03c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 -- 172.21.15.100:0/911462291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd03c102660 msgr2=0x7fd03c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd03c102660 0x7fd03c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:22.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 -- 172.21.15.100:0/911462291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd03c1078c0 msgr2=0x7fd03c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd03c1078c0 0x7fd03c19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 -- 172.21.15.100:0/911462291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c19fbd0 con 0x7fd03c104f90 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd03a7fc640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c104f90 0x7fd03c1984e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd02400b450 tx=0x7fd02400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd033fff640 1 -- 172.21.15.100:0/911462291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024015020 con 0x7fd03c104f90 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd033fff640 1 -- 172.21.15.100:0/911462291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd024011d70 con 0x7fd03c104f90 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.955+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03c19fec0 con 0x7fd03c104f90 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.956+0000 7fd033fff640 1 -- 172.21.15.100:0/911462291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02400f340 con 0x7fd03c104f90 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.956+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03c1a03a0 con 0x7fd03c104f90 2024-09-12T02:06:22.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.956+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03c0fdd70 con 0x7fd03c104f90 2024-09-12T02:06:22.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.958+0000 7fd033fff640 1 -- 172.21.15.100:0/911462291 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd024018020 con 0x7fd03c104f90 2024-09-12T02:06:22.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.959+0000 7fd033fff640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd0280a2c40 0x7fd0280a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:22.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.959+0000 7fd033fff640 1 -- 172.21.15.100:0/911462291 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd0240cefc0 con 0x7fd03c104f90 2024-09-12T02:06:22.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.959+0000 7fd03affd640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd0280a2c40 0x7fd0280a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:22.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.960+0000 7fd03affd640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd0280a2c40 0x7fd0280a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd02c006010 tx=0x7fd02c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:22.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:22.963+0000 7fd033fff640 1 -- 172.21.15.100:0/911462291 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd02401f020 con 0x7fd03c104f90 2024-09-12T02:06:23.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.144+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fd03c062630 con 0x7fd0280a2c40 2024-09-12T02:06:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.145+0000 7fd033fff640 1 -- 172.21.15.100:0/911462291 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fd03c062630 con 0x7fd0280a2c40 2024-09-12T02:06:23.146 INFO:teuthology.orchestra.run.smithi100.stdout:Backend: cephadm 2024-09-12T02:06:23.146 INFO:teuthology.orchestra.run.smithi100.stdout:Available: Yes 2024-09-12T02:06:23.146 INFO:teuthology.orchestra.run.smithi100.stdout:Paused: No 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd0280a2c40 msgr2=0x7fd0280a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd0280a2c40 0x7fd0280a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd02c006010 tx=0x7fd02c000f40 comp rx=0 tx=0).stop 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c104f90 msgr2=0x7fd03c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c104f90 0x7fd03c1984e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd02400b450 tx=0x7fd02400b910 comp rx=0 tx=0).stop 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 shutdown_connections 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd0280a2c40 0x7fd0280a5100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd03c1078c0 0x7fd03c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd03c104f90 0x7fd03c1984e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 --2- 172.21.15.100:0/911462291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd03c102660 0x7fd03c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:23.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 >> 172.21.15.100:0/911462291 conn(0x7fd03c0fc280 msgr2=0x7fd03c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:23.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 shutdown_connections 2024-09-12T02:06:23.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:23.148+0000 7fd0414c5640 1 -- 172.21.15.100:0/911462291 wait complete. 2024-09-12T02:06:23.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:23 smithi100 ceph-mon[31179]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:23 smithi189 ceph-mon[35188]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:23.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:23 smithi117 ceph-mon[35240]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:23.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T02:06:24.005 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:24.432 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:24 smithi100 ceph-mon[31179]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 -- 172.21.15.100:0/2563326700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f0101c00 msgr2=0x7f09f0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 --2- 172.21.15.100:0/2563326700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f0101c00 0x7f09f0102000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009900 tx=0x7f09e002a410 comp rx=0 tx=0).stop 2024-09-12T02:06:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 -- 172.21.15.100:0/2563326700 shutdown_connections 2024-09-12T02:06:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 --2- 172.21.15.100:0/2563326700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f01037c0 0x7f09f010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 --2- 172.21.15.100:0/2563326700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f0102e00 0x7f09f0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 --2- 172.21.15.100:0/2563326700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f0101c00 0x7f09f0102000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 -- 172.21.15.100:0/2563326700 >> 172.21.15.100:0/2563326700 conn(0x7f09f00fd390 msgr2=0x7f09f00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 -- 172.21.15.100:0/2563326700 shutdown_connections 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.511+0000 7f09f6472640 1 -- 172.21.15.100:0/2563326700 wait complete. 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 Processor -- start 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 -- start start 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0101c00 0x7f09f0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f0102e00 0x7f09f01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f01037c0 0x7f09f019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09f010d900 con 0x7f09f01037c0 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f09f010d780 con 0x7f09f0102e00 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f6472640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f09f010da80 con 0x7f09f0101c00 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f4a0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f01037c0 0x7f09f019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:24.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f4a0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f01037c0 0x7f09f019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33568/0 (socket says 172.21.15.100:33568) 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09f4a0f640 1 -- 172.21.15.100:0/1001064038 learned_addr learned my addr 172.21.15.100:0/1001064038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.512+0000 7f09effff640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0101c00 0x7f09f0197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09ef7fe640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f0102e00 0x7f09f01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f4a0f640 1 -- 172.21.15.100:0/1001064038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0101c00 msgr2=0x7f09f0197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f4a0f640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0101c00 0x7f09f0197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f4a0f640 1 -- 172.21.15.100:0/1001064038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f0102e00 msgr2=0x7f09f01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f4a0f640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f0102e00 0x7f09f01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f4a0f640 1 -- 172.21.15.100:0/1001064038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f019fba0 con 0x7f09f01037c0 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09ef7fe640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f0102e00 0x7f09f01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f4a0f640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f01037c0 0x7f09f019f530 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f09e800eaa0 tx=0x7f09e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09ed7fa640 1 -- 172.21.15.100:0/1001064038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e800cdb0 con 0x7f09f01037c0 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09ed7fa640 1 -- 172.21.15.100:0/1001064038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09e8005020 con 0x7f09f01037c0 2024-09-12T02:06:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09ed7fa640 1 -- 172.21.15.100:0/1001064038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e80116b0 con 0x7f09f01037c0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f019fe90 con 0x7f09f01037c0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.513+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f01a03c0 con 0x7f09f01037c0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.514+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f0109000 con 0x7f09f01037c0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.515+0000 7f09ed7fa640 1 -- 172.21.15.100:0/1001064038 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f09e8005560 con 0x7f09f01037c0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.516+0000 7f09ed7fa640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09d80a2c40 0x7f09d80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.516+0000 7f09effff640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09d80a2c40 0x7f09d80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.516+0000 7f09ed7fa640 1 -- 172.21.15.100:0/1001064038 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09e80cf3c0 con 0x7f09f01037c0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.516+0000 7f09effff640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09d80a2c40 0x7f09d80a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09e0005ab0 tx=0x7f09e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.520+0000 7f09ed7fa640 1 -- 172.21.15.100:0/1001064038 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09e8016030 con 0x7f09f01037c0 2024-09-12T02:06:24.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:24 smithi189 ceph-mon[35188]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:24.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:24 smithi117 ceph-mon[35240]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.694+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f09f0062630 con 0x7f09d80a2c40 2024-09-12T02:06:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.706+0000 7f09ed7fa640 1 -- 172.21.15.100:0/1001064038 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f09f0062630 con 0x7f09d80a2c40 2024-09-12T02:06:24.706 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T02:06:24.706 INFO:teuthology.orchestra.run.smithi100.stdout:mds.a smithi100 running (90s) 15s ago 90s 14.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 3627d61471d6 2024-09-12T02:06:24.706 INFO:teuthology.orchestra.run.smithi100.stdout:mds.b smithi117 running (88s) 21s ago 87s 26.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 ed4b3baae4f4 2024-09-12T02:06:24.706 INFO:teuthology.orchestra.run.smithi100.stdout:mds.c smithi189 running (102s) 21s ago 101s 17.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 71f315c27e5a 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.d smithi100 running (109s) 15s ago 108s 13.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 37ac9312cbbc 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.e smithi117 running (106s) 21s ago 106s 18.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 14154e07bc81 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.f smithi189 running (104s) 21s ago 103s 16.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 4a88eac77cc3 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.g smithi100 running (94s) 15s ago 93s 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 436c8e523b0c 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.h smithi117 running (99s) 21s ago 99s 20.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 07958c8f856c 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.i smithi189 running (97s) 21s ago 96s 19.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 aa2da3149152 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.j smithi100 running (112s) 15s ago 112s 16.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 6c5eebf8ab2e 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.k smithi117 running (115s) 21s ago 115s 13.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 36bbe14017a5 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mds.l smithi189 running (118s) 21s ago 117s 13.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 2ccae9915985 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.x smithi100 *:9283,8765 running (8m) 15s ago 8m 508M - 19.1.1-298-gb53b6d3e 54467abc55f8 9d4297736980 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.y smithi117 *:8443,8765 running (7m) 21s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 7b22ae880252 2024-09-12T02:06:24.707 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.z smithi189 *:8443,8765 running (7m) 21s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 49d5bf957f82 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:mon.a smithi100 running (8m) 15s ago 8m 54.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 ba90479fb30c 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:mon.b smithi117 running (7m) 21s ago 7m 40.4M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 28878a8a4671 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:mon.c smithi189 running (7m) 21s ago 7m 40.4M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 403fe64726f3 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (6m) 15s ago 6m 47.8M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 684248ab6c25 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi117 running (6m) 21s ago 6m 56.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 f74504c486fd 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi189 running (5m) 21s ago 5m 51.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ffdec48412bf 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi100 running (5m) 15s ago 5m 54.1M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 e3b0db0a67d2 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi117 running (5m) 21s ago 5m 45.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 eee99d73db97 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi189 running (4m) 21s ago 4m 49.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ce2b2a7de6f8 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 smithi100 running (4m) 15s ago 4m 47.2M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 db75a9eb07e2 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 smithi117 running (3m) 21s ago 3m 53.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 f66fcf8adce7 2024-09-12T02:06:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:osd.8 smithi189 running (3m) 21s ago 3m 48.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 4be5b8c39c5e 2024-09-12T02:06:24.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.9 smithi100 running (3m) 15s ago 3m 52.2M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 3c37a23ab926 2024-09-12T02:06:24.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.10 smithi117 running (2m) 21s ago 2m 46.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 0bc5b20aa7e6 2024-09-12T02:06:24.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.11 smithi189 running (2m) 21s ago 2m 44.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 6dcf6fe5d20d 2024-09-12T02:06:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09d80a2c40 msgr2=0x7f09d80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09d80a2c40 0x7f09d80a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09e0005ab0 tx=0x7f09e0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f01037c0 msgr2=0x7f09f019f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f01037c0 0x7f09f019f530 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f09e800eaa0 tx=0x7f09e800ef60 comp rx=0 tx=0).stop 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 shutdown_connections 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09d80a2c40 0x7f09d80a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09f01037c0 0x7f09f019f530 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f0102e00 0x7f09f01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 --2- 172.21.15.100:0/1001064038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0101c00 0x7f09f0197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 >> 172.21.15.100:0/1001064038 conn(0x7f09f00fd390 msgr2=0x7f09f01061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 shutdown_connections 2024-09-12T02:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:24.708+0000 7f09f6472640 1 -- 172.21.15.100:0/1001064038 wait complete. 2024-09-12T02:06:25.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T02:06:25.518 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:25.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:25 smithi100 ceph-mon[31179]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:25.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:25 smithi189 ceph-mon[35188]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:25.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:25 smithi117 ceph-mon[35240]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.901+0000 7f30e5dfc640 1 -- 172.21.15.100:0/1490003415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e01026d0 msgr2=0x7f30e0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.901+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/1490003415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e01026d0 0x7f30e0108f60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009900 tx=0x7f30d802a410 comp rx=0 tx=0).stop 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- 172.21.15.100:0/1490003415 shutdown_connections 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/1490003415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e01026d0 0x7f30e0108f60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/1490003415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30e0101d10 0x7f30e0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/1490003415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e0100b10 0x7f30e0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- 172.21.15.100:0/1490003415 >> 172.21.15.100:0/1490003415 conn(0x7f30e00fc2a0 msgr2=0x7f30e00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- 172.21.15.100:0/1490003415 shutdown_connections 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- 172.21.15.100:0/1490003415 wait complete. 2024-09-12T02:06:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 Processor -- start 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- start start 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e0100b10 0x7f30e0104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30e0101d10 0x7f30e0103240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e01026d0 0x7f30e0103780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30e010c7f0 con 0x7f30e0100b10 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30e010c670 con 0x7f30e01026d0 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.902+0000 7f30e5dfc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30e010c970 con 0x7f30e0101d10 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e0100b10 0x7f30e0104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e0100b10 0x7f30e0104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33584/0 (socket says 172.21.15.100:33584) 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 -- 172.21.15.100:0/372669064 learned_addr learned my addr 172.21.15.100:0/372669064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30deffd640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30e0101d10 0x7f30e0103240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30dffff640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e01026d0 0x7f30e0103780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 -- 172.21.15.100:0/372669064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30e0101d10 msgr2=0x7f30e0103240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30e0101d10 0x7f30e0103240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 -- 172.21.15.100:0/372669064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e01026d0 msgr2=0x7f30e0103780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e01026d0 0x7f30e0103780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 -- 172.21.15.100:0/372669064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e0104040 con 0x7f30e0100b10 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30df7fe640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e0100b10 0x7f30e0104bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f30d000ccb0 tx=0x7f30d000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30dcff9640 1 -- 172.21.15.100:0/372669064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0003990 con 0x7f30e0100b10 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30dcff9640 1 -- 172.21.15.100:0/372669064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30d0003b30 con 0x7f30e0100b10 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e01a2090 con 0x7f30e0100b10 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30dcff9640 1 -- 172.21.15.100:0/372669064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d000f740 con 0x7f30e0100b10 2024-09-12T02:06:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.903+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e01a2670 con 0x7f30e0100b10 2024-09-12T02:06:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.904+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e01a2900 con 0x7f30e0100b10 2024-09-12T02:06:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.905+0000 7f30dcff9640 1 -- 172.21.15.100:0/372669064 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f30d0004a40 con 0x7f30e0100b10 2024-09-12T02:06:25.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.906+0000 7f30dcff9640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30cc0a2c90 0x7f30cc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:25.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.906+0000 7f30deffd640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30cc0a2c90 0x7f30cc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:25.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.906+0000 7f30dcff9640 1 -- 172.21.15.100:0/372669064 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f30d00cf580 con 0x7f30e0100b10 2024-09-12T02:06:25.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.907+0000 7f30deffd640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30cc0a2c90 0x7f30cc0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30e0104970 tx=0x7f30c8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:25.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:25.909+0000 7f30dcff9640 1 -- 172.21.15.100:0/372669064 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30d0014030 con 0x7f30e0100b10 2024-09-12T02:06:26.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.086+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f30e0062630 con 0x7f30cc0a2c90 2024-09-12T02:06:26.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.091+0000 7f30dcff9640 1 -- 172.21.15.100:0/372669064 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f30e0062630 con 0x7f30cc0a2c90 2024-09-12T02:06:26.092 INFO:teuthology.orchestra.run.smithi100.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T02:06:26.092 INFO:teuthology.orchestra.run.smithi100.stdout:mds.all 12/12 23s ago 2m smithi100=a;smithi100=d;smithi100=g;smithi100=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T02:06:26.092 INFO:teuthology.orchestra.run.smithi100.stdout:mgr 3/3 23s ago 7m smithi100=x;smithi117=y;smithi189=z;count:3 2024-09-12T02:06:26.092 INFO:teuthology.orchestra.run.smithi100.stdout:mon 3/3 23s ago 7m smithi100:172.21.15.100=a;smithi117:172.21.15.117=b;smithi189:172.21.15.189=c;count:3 2024-09-12T02:06:26.092 INFO:teuthology.orchestra.run.smithi100.stdout:osd 12 23s ago - 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30cc0a2c90 msgr2=0x7f30cc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30cc0a2c90 0x7f30cc0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30e0104970 tx=0x7f30c8009110 comp rx=0 tx=0).stop 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e0100b10 msgr2=0x7f30e0104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e0100b10 0x7f30e0104bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f30d000ccb0 tx=0x7f30d000a620 comp rx=0 tx=0).stop 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 shutdown_connections 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f30cc0a2c90 0x7f30cc0a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e01026d0 0x7f30e0103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30e0101d10 0x7f30e0103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 --2- 172.21.15.100:0/372669064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e0100b10 0x7f30e0104bf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.093+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 >> 172.21.15.100:0/372669064 conn(0x7f30e00fc2a0 msgr2=0x7f30e00fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.094+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 shutdown_connections 2024-09-12T02:06:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:26.094+0000 7f30e5dfc640 1 -- 172.21.15.100:0/372669064 wait complete. 2024-09-12T02:06:26.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:26 smithi100 ceph-mon[31179]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:26.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:26 smithi189 ceph-mon[35188]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:26.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:26 smithi117 ceph-mon[35240]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:26.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T02:06:26.954 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:27.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:27 smithi100 ceph-mon[31179]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:27.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:27 smithi100 ceph-mon[31179]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:27.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.526+0000 7f4941746640 1 -- 172.21.15.100:0/3919817796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c102690 msgr2=0x7f493c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.526+0000 7f4941746640 1 --2- 172.21.15.100:0/3919817796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c102690 0x7f493c108f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4934009ca0 tx=0x7f493402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- 172.21.15.100:0/3919817796 shutdown_connections 2024-09-12T02:06:27.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 --2- 172.21.15.100:0/3919817796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c102690 0x7f493c108f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 --2- 172.21.15.100:0/3919817796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f493c101cd0 0x7f493c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 --2- 172.21.15.100:0/3919817796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f493c100ad0 0x7f493c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- 172.21.15.100:0/3919817796 >> 172.21.15.100:0/3919817796 conn(0x7f493c0fc280 msgr2=0x7f493c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- 172.21.15.100:0/3919817796 shutdown_connections 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- 172.21.15.100:0/3919817796 wait complete. 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 Processor -- start 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- start start 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c100ad0 0x7f493c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f493c101cd0 0x7f493c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f493c102690 0x7f493c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10d8e0 con 0x7f493c100ad0 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10d760 con 0x7f493c101cd0 2024-09-12T02:06:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.527+0000 7f4941746640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f493c10da60 con 0x7f493c102690 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c100ad0 0x7f493c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c100ad0 0x7f493c197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33610/0 (socket says 172.21.15.100:33610) 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 -- 172.21.15.100:0/2965130507 learned_addr learned my addr 172.21.15.100:0/2965130507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493b7fe640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f493c102690 0x7f493c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493a7fc640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f493c101cd0 0x7f493c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 -- 172.21.15.100:0/2965130507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f493c102690 msgr2=0x7f493c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f493c102690 0x7f493c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 -- 172.21.15.100:0/2965130507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f493c101cd0 msgr2=0x7f493c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f493c101cd0 0x7f493c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 -- 172.21.15.100:0/2965130507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c19fad0 con 0x7f493c100ad0 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493a7fc640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f493c101cd0 0x7f493c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f493affd640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c100ad0 0x7f493c197ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f492c00b450 tx=0x7f492c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f4923fff640 1 -- 172.21.15.100:0/2965130507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c015020 con 0x7f493c100ad0 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c19fdc0 con 0x7f493c100ad0 2024-09-12T02:06:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f4923fff640 1 -- 172.21.15.100:0/2965130507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f492c011d70 con 0x7f493c100ad0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f4923fff640 1 -- 172.21.15.100:0/2965130507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c00f340 con 0x7f493c100ad0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.528+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c1a02a0 con 0x7f493c100ad0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.529+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493c107e20 con 0x7f493c100ad0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.530+0000 7f4923fff640 1 -- 172.21.15.100:0/2965130507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f492c018020 con 0x7f493c100ad0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.531+0000 7f4923fff640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f49240a2c40 0x7f49240a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.531+0000 7f493a7fc640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f49240a2c40 0x7f49240a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.532+0000 7f4923fff640 1 -- 172.21.15.100:0/2965130507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f492c0ceac0 con 0x7f493c100ad0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.532+0000 7f493a7fc640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f49240a2c40 0x7f49240a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f493c1993c0 tx=0x7f493000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.536+0000 7f4923fff640 1 -- 172.21.15.100:0/2965130507 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f492c01f020 con 0x7f493c100ad0 2024-09-12T02:06:27.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:27 smithi189 ceph-mon[35188]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:27.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:27 smithi189 ceph-mon[35188]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:27.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:27 smithi117 ceph-mon[35240]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:27.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:27 smithi117 ceph-mon[35240]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:27.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.710+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f493c062630 con 0x7f49240a2c40 2024-09-12T02:06:27.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.711+0000 7f4923fff640 1 -- 172.21.15.100:0/2965130507 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f493c062630 con 0x7f49240a2c40 2024-09-12T02:06:27.711 INFO:teuthology.orchestra.run.smithi100.stdout:HOST ADDR LABELS STATUS 2024-09-12T02:06:27.711 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 172.21.15.100 2024-09-12T02:06:27.711 INFO:teuthology.orchestra.run.smithi100.stdout:smithi117 172.21.15.117 2024-09-12T02:06:27.711 INFO:teuthology.orchestra.run.smithi100.stdout:smithi189 172.21.15.189 2024-09-12T02:06:27.711 INFO:teuthology.orchestra.run.smithi100.stdout:3 hosts in cluster 2024-09-12T02:06:27.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f49240a2c40 msgr2=0x7f49240a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f49240a2c40 0x7f49240a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f493c1993c0 tx=0x7f493000a5c0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c100ad0 msgr2=0x7f493c197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c100ad0 0x7f493c197ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f492c00b450 tx=0x7f492c00b910 comp rx=0 tx=0).stop 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 shutdown_connections 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f49240a2c40 0x7f49240a5100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f493c102690 0x7f493c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f493c101cd0 0x7f493c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 --2- 172.21.15.100:0/2965130507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f493c100ad0 0x7f493c197ea0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 >> 172.21.15.100:0/2965130507 conn(0x7f493c0fc280 msgr2=0x7f493c104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.713+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 shutdown_connections 2024-09-12T02:06:27.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:27.714+0000 7f4941746640 1 -- 172.21.15.100:0/2965130507 wait complete. 2024-09-12T02:06:28.376 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T02:06:28.620 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:29.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 -- 172.21.15.100:0/549294255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1026a0 msgr2=0x7f5a1c104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/549294255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1026a0 0x7f5a1c104a90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009900 tx=0x7f5a0c02a410 comp rx=0 tx=0).stop 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 -- 172.21.15.100:0/549294255 shutdown_connections 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/549294255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c107900 0x7f5a1c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/549294255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c104fd0 0x7f5a1c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/549294255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c1026a0 0x7f5a1c104a90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 -- 172.21.15.100:0/549294255 >> 172.21.15.100:0/549294255 conn(0x7f5a1c0fc2a0 msgr2=0x7f5a1c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 -- 172.21.15.100:0/549294255 shutdown_connections 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.126+0000 7f5a23b2c640 1 -- 172.21.15.100:0/549294255 wait complete. 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 Processor -- start 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 -- start start 2024-09-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c1026a0 0x7f5a1c102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c104fd0 0x7f5a1c100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c107900 0x7f5a1c100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c10d940 con 0x7f5a1c107900 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c10d7c0 con 0x7f5a1c1026a0 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a23b2c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c10dac0 con 0x7f5a1c104fd0 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a220c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c107900 0x7f5a1c100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a220c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c107900 0x7f5a1c100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33616/0 (socket says 172.21.15.100:33616) 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a220c9640 1 -- 172.21.15.100:0/515221027 learned_addr learned my addr 172.21.15.100:0/515221027 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a210c7640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c104fd0 0x7f5a1c100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.127+0000 7f5a218c8640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c1026a0 0x7f5a1c102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a220c9640 1 -- 172.21.15.100:0/515221027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c104fd0 msgr2=0x7f5a1c100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a220c9640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c104fd0 0x7f5a1c100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a220c9640 1 -- 172.21.15.100:0/515221027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c1026a0 msgr2=0x7f5a1c102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a220c9640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c1026a0 0x7f5a1c102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a220c9640 1 -- 172.21.15.100:0/515221027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c101450 con 0x7f5a1c107900 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a218c8640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c1026a0 0x7f5a1c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a220c9640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c107900 0x7f5a1c100b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400b970 tx=0x7f5a1400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a12ffd640 1 -- 172.21.15.100:0/515221027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14019070 con 0x7f5a1c107900 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1c1a2160 con 0x7f5a1c107900 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a12ffd640 1 -- 172.21.15.100:0/515221027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a1400cb40 con 0x7f5a1c107900 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a12ffd640 1 -- 172.21.15.100:0/515221027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14007650 con 0x7f5a1c107900 2024-09-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.128+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1c1a26f0 con 0x7f5a1c107900 2024-09-12T02:06:29.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.129+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1c0fdd90 con 0x7f5a1c107900 2024-09-12T02:06:29.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.130+0000 7f5a12ffd640 1 -- 172.21.15.100:0/515221027 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5a1401c070 con 0x7f5a1c107900 2024-09-12T02:06:29.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.131+0000 7f5a12ffd640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5a080a2c90 0x7f5a080a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:29.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.131+0000 7f5a218c8640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5a080a2c90 0x7f5a080a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:29.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.131+0000 7f5a12ffd640 1 -- 172.21.15.100:0/515221027 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5a140ce640 con 0x7f5a1c107900 2024-09-12T02:06:29.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.131+0000 7f5a218c8640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5a080a2c90 0x7f5a080a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c000c00 tx=0x7f5a0c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.135+0000 7f5a12ffd640 1 -- 172.21.15.100:0/515221027 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a1409aeb0 con 0x7f5a1c107900 2024-09-12T02:06:29.307 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:29 smithi100 ceph-mon[31179]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:29.307 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:29 smithi100 ceph-mon[31179]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.307+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5a1c062630 con 0x7f5a080a2c90 2024-09-12T02:06:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.308+0000 7f5a12ffd640 1 -- 172.21.15.100:0/515221027 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5a1c062630 con 0x7f5a080a2c90 2024-09-12T02:06:29.308 INFO:teuthology.orchestra.run.smithi100.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T02:06:29.308 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:06:29.308 INFO:teuthology.orchestra.run.smithi100.stdout:smithi117 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V6400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T02:06:29.309 INFO:teuthology.orchestra.run.smithi100.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T02:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5a080a2c90 msgr2=0x7f5a080a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5a080a2c90 0x7f5a080a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c000c00 tx=0x7f5a0c031400 comp rx=0 tx=0).stop 2024-09-12T02:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c107900 msgr2=0x7f5a1c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c107900 0x7f5a1c100b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400b970 tx=0x7f5a1400be30 comp rx=0 tx=0).stop 2024-09-12T02:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 shutdown_connections 2024-09-12T02:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5a080a2c90 0x7f5a080a5150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1c107900 0x7f5a1c100b90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c104fd0 0x7f5a1c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 --2- 172.21.15.100:0/515221027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c1026a0 0x7f5a1c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 >> 172.21.15.100:0/515221027 conn(0x7f5a1c0fc2a0 msgr2=0x7f5a1c103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 shutdown_connections 2024-09-12T02:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:29.311+0000 7f5a23b2c640 1 -- 172.21.15.100:0/515221027 wait complete. 2024-09-12T02:06:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:29 smithi189 ceph-mon[35188]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:29 smithi189 ceph-mon[35188]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:29.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:29 smithi117 ceph-mon[35240]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:29.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:29 smithi117 ceph-mon[35240]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:29.862 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:06:29.871 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:06:29.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T02:06:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.562+0000 7fecaf5e1640 1 -- 172.21.15.100:0/466246595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8102690 msgr2=0x7feca8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.562+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/466246595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8102690 0x7feca8108f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feca0009ca0 tx=0x7feca002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.562+0000 7fecaf5e1640 1 -- 172.21.15.100:0/466246595 shutdown_connections 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.562+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/466246595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8102690 0x7feca8108f20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.562+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/466246595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feca8101cd0 0x7feca8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.562+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/466246595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feca8100ad0 0x7feca8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.562+0000 7fecaf5e1640 1 -- 172.21.15.100:0/466246595 >> 172.21.15.100:0/466246595 conn(0x7feca80fc280 msgr2=0x7feca80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 -- 172.21.15.100:0/466246595 shutdown_connections 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 -- 172.21.15.100:0/466246595 wait complete. 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 Processor -- start 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 -- start start 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8100ad0 0x7feca8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feca8101cd0 0x7feca8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feca8102690 0x7feca819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feca810c730 con 0x7feca8100ad0 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feca810c5b0 con 0x7feca8101cd0 2024-09-12T02:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.563+0000 7fecaf5e1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feca810c8b0 con 0x7feca8102690 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8100ad0 0x7feca8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8100ad0 0x7feca8197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33636/0 (socket says 172.21.15.100:33636) 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 -- 172.21.15.100:0/3944635992 learned_addr learned my addr 172.21.15.100:0/3944635992 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecacb7c640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feca8101cd0 0x7feca8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecadb7e640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feca8102690 0x7feca819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 -- 172.21.15.100:0/3944635992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feca8102690 msgr2=0x7feca819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feca8102690 0x7feca819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 -- 172.21.15.100:0/3944635992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feca8101cd0 msgr2=0x7feca8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feca8101cd0 0x7feca8198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 -- 172.21.15.100:0/3944635992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca819fa40 con 0x7feca8100ad0 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecacb7c640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feca8101cd0 0x7feca8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:30.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecad37d640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8100ad0 0x7feca8197e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feca400d770 tx=0x7feca400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fec9e7fc640 1 -- 172.21.15.100:0/3944635992 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4017070 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca819fd30 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fec9e7fc640 1 -- 172.21.15.100:0/3944635992 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca4009c30 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fec9e7fc640 1 -- 172.21.15.100:0/3944635992 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4003dd0 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.564+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca81a0200 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.565+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca81a0430 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.567+0000 7fec9e7fc640 1 -- 172.21.15.100:0/3944635992 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7feca4003f70 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.567+0000 7fec9e7fc640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec940a2c40 0x7fec940a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.567+0000 7fecacb7c640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec940a2c40 0x7fec940a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.567+0000 7fec9e7fc640 1 -- 172.21.15.100:0/3944635992 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feca40cefc0 con 0x7feca8100ad0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.568+0000 7fecacb7c640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec940a2c40 0x7fec940a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feca8199330 tx=0x7fec9800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:30.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.571+0000 7fec9e7fc640 1 -- 172.21.15.100:0/3944635992 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feca4009de0 con 0x7feca8100ad0 2024-09-12T02:06:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.775+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7feca81a07c0 con 0x7feca8100ad0 2024-09-12T02:06:30.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.776+0000 7fec9e7fc640 1 -- 172.21.15.100:0/3944635992 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3098 (secure 0 0 0) 0x7feca409bdd0 con 0x7feca8100ad0 2024-09-12T02:06:30.776 INFO:teuthology.orchestra.run.smithi100.stdout:e23 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-12T02:05:19:082439+0000 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 23 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T02:06:30.777 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-12T02:05:07.550581+0000 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-12T02:05:18.350451+0000 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 300 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-12T02:06:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 0 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 3 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1,2 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=24452,1=24433,2=24428} 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-12T02:06:30.779 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 0 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 24452 members: 24452,24433,24428 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b{0:24452} state up:active seq 4 addr [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c{0:24427} state up:standby-replay seq 1 addr [v2:172.21.15.189:6836/3569067822,v1:172.21.15.189:6837/3569067822] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.i{1:24433} state up:active seq 8 addr [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f{1:24418} state up:standby-replay seq 1 addr [v2:172.21.15.189:6834/2566860695,v1:172.21.15.189:6835/2566860695] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.h{2:24428} state up:active seq 9 addr [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.780 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e{2:24410} state up:standby-replay seq 1 addr [v2:172.21.15.117:6834/3915021752,v1:172.21.15.117:6835/3915021752] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.100:6834/984711890,v1:172.21.15.100:6835/984711890] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d{-1:14550} state up:standby seq 1 addr [v2:172.21.15.100:6836/650735571,v1:172.21.15.100:6837/650735571] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.g{-1:14598} state up:standby seq 1 addr [v2:172.21.15.100:6838/3243845929,v1:172.21.15.100:6839/3243845929] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a{-1:14610} state up:standby seq 1 addr [v2:172.21.15.100:6840/1518201039,v1:172.21.15.100:6841/1518201039] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.781 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.k{-1:24380} state up:standby seq 1 addr [v2:172.21.15.117:6832/1856036067,v1:172.21.15.117:6833/1856036067] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.782 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.l{-1:24397} state up:standby seq 1 addr [v2:172.21.15.189:6832/2089566661,v1:172.21.15.189:6833/2089566661] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:06:30.782 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec940a2c40 msgr2=0x7fec940a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec940a2c40 0x7fec940a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feca8199330 tx=0x7fec9800a5c0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8100ad0 msgr2=0x7feca8197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8100ad0 0x7feca8197e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feca400d770 tx=0x7feca400dc30 comp rx=0 tx=0).stop 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 shutdown_connections 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fec940a2c40 0x7fec940a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feca8102690 0x7feca819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feca8101cd0 0x7feca8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 --2- 172.21.15.100:0/3944635992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feca8100ad0 0x7feca8197e10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:30.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 >> 172.21.15.100:0/3944635992 conn(0x7feca80fc280 msgr2=0x7feca80fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:30.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 shutdown_connections 2024-09-12T02:06:30.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:30.778+0000 7fecaf5e1640 1 -- 172.21.15.100:0/3944635992 wait complete. 2024-09-12T02:06:31.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:31 smithi117 ceph-mon[35240]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:31.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:31 smithi117 ceph-mon[35240]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:31.453 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:31 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3944635992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:06:31.469 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:31 smithi100 ceph-mon[31179]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:31.470 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:31 smithi100 ceph-mon[31179]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:31.470 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:31 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3944635992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:06:31.499 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T02:06:31.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:31 smithi189 ceph-mon[35188]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:31.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:31 smithi189 ceph-mon[35188]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:31.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:31 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3944635992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:06:31.749 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 -- 172.21.15.100:0/2398771533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 msgr2=0x7fcba8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 --2- 172.21.15.100:0/2398771533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8103280 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009900 tx=0x7fcb9802a410 comp rx=0 tx=0).stop 2024-09-12T02:06:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 -- 172.21.15.100:0/2398771533 shutdown_connections 2024-09-12T02:06:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 --2- 172.21.15.100:0/2398771533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba81037c0 0x7fcba810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 --2- 172.21.15.100:0/2398771533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8103280 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 --2- 172.21.15.100:0/2398771533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba8101c00 0x7fcba8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 -- 172.21.15.100:0/2398771533 >> 172.21.15.100:0/2398771533 conn(0x7fcba80fd390 msgr2=0x7fcba80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 -- 172.21.15.100:0/2398771533 shutdown_connections 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.218+0000 7fcbacc95640 1 -- 172.21.15.100:0/2398771533 wait complete. 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 Processor -- start 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 -- start start 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8101c00 0x7fcba8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba81037c0 0x7fcba819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcba810d860 con 0x7fcba8102e00 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcba810d6e0 con 0x7fcba81037c0 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcbacc95640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcba810d9e0 con 0x7fcba8101c00 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcba5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcba5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33642/0 (socket says 172.21.15.100:33642) 2024-09-12T02:06:32.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.219+0000 7fcba5d9b640 1 -- 172.21.15.100:0/1337368404 learned_addr learned my addr 172.21.15.100:0/1337368404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba659c640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8101c00 0x7fcba8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba6d9d640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba81037c0 0x7fcba819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba5d9b640 1 -- 172.21.15.100:0/1337368404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8101c00 msgr2=0x7fcba8197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba5d9b640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8101c00 0x7fcba8197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba5d9b640 1 -- 172.21.15.100:0/1337368404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba81037c0 msgr2=0x7fcba819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba5d9b640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba81037c0 0x7fcba819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba5d9b640 1 -- 172.21.15.100:0/1337368404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba819fb10 con 0x7fcba8102e00 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba6d9d640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba81037c0 0x7fcba819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcba5d9b640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8198420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009230 tx=0x7fcb98031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcb977fe640 1 -- 172.21.15.100:0/1337368404 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9803f030 con 0x7fcba8102e00 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcb977fe640 1 -- 172.21.15.100:0/1337368404 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb98003ad0 con 0x7fcba8102e00 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba819fda0 con 0x7fcba8102e00 2024-09-12T02:06:32.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcb977fe640 1 -- 172.21.15.100:0/1337368404 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98035070 con 0x7fcba8102e00 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.220+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba81a0270 con 0x7fcba8102e00 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.221+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba81090a0 con 0x7fcba8102e00 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.222+0000 7fcb977fe640 1 -- 172.21.15.100:0/1337368404 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcb98042030 con 0x7fcba8102e00 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.223+0000 7fcb977fe640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcb900a2cc0 0x7fcb900a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.223+0000 7fcba659c640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcb900a2cc0 0x7fcb900a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.223+0000 7fcb977fe640 1 -- 172.21.15.100:0/1337368404 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcb980ef620 con 0x7fcba8102e00 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.223+0000 7fcba659c640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcb900a2cc0 0x7fcb900a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcba8102c60 tx=0x7fcb9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.227+0000 7fcb977fe640 1 -- 172.21.15.100:0/1337368404 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb980bbde0 con 0x7fcba8102e00 2024-09-12T02:06:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.396+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fcba802da10 con 0x7fcba8102e00 2024-09-12T02:06:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.397+0000 7fcb977fe640 1 -- 172.21.15.100:0/1337368404 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5314 (secure 0 0 0) 0x7fcb980c00e0 con 0x7fcba8102e00 2024-09-12T02:06:32.397 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 82 2024-09-12T02:06:32.397 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-12T01:57:36.930004+0000 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-12T02:05:23.109874+0000 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:crush_version 26 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:full_ratio 0.95 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:backfillfull_ratio 0.9 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:nearfull_ratio 0.85 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:require_min_compat_client luminous 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:min_compat_client luminous 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:require_osd_release squid 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:stretch_mode_enabled false 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T02:06:32.398 INFO:teuthology.orchestra.run.smithi100.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:max_osd 12 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6802/590713730,v1:172.21.15.100:6803/590713730] [v2:172.21.15.100:6804/590713730,v1:172.21.15.100:6805/590713730] exists,up b493f8bd-74b9-487f-a058-e4bb350868c3 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/2755635305,v1:172.21.15.117:6801/2755635305] [v2:172.21.15.117:6802/2755635305,v1:172.21.15.117:6803/2755635305] exists,up 9d934f40-d17c-4cc0-bf73-2e7afa558fee 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 up in weight 1 up_from 17 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/1587987599,v1:172.21.15.189:6801/1587987599] [v2:172.21.15.189:6802/1587987599,v1:172.21.15.189:6803/1587987599] exists,up d8dc133a-5014-4f6a-8f17-33a94f1f84f5 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 up in weight 1 up_from 23 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6810/2982818857,v1:172.21.15.100:6811/2982818857] [v2:172.21.15.100:6812/2982818857,v1:172.21.15.100:6813/2982818857] exists,up d4d57e9c-f48a-4a2d-a8ce-03a263a479a8 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 up in weight 1 up_from 30 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6808/855252072,v1:172.21.15.117:6809/855252072] [v2:172.21.15.117:6810/855252072,v1:172.21.15.117:6811/855252072] exists,up f6ac3570-1a74-41a5-8499-f05ebb8dda78 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 up in weight 1 up_from 35 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/3192404099,v1:172.21.15.189:6809/3192404099] [v2:172.21.15.189:6810/3192404099,v1:172.21.15.189:6811/3192404099] exists,up f3a5c2d4-bcf3-4436-8bec-636f3afb33bb 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 up in weight 1 up_from 42 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6818/4036405723,v1:172.21.15.100:6819/4036405723] [v2:172.21.15.100:6820/4036405723,v1:172.21.15.100:6821/4036405723] exists,up ff037492-9e8b-4d22-9ba3-6037e1a6768f 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 up in weight 1 up_from 47 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6816/3443138169,v1:172.21.15.117:6817/3443138169] [v2:172.21.15.117:6818/3443138169,v1:172.21.15.117:6819/3443138169] exists,up 011b6708-d8e1-4507-833e-741dc9a33420 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.8 up in weight 1 up_from 54 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/1310528835,v1:172.21.15.189:6817/1310528835] [v2:172.21.15.189:6818/1310528835,v1:172.21.15.189:6819/1310528835] exists,up 0a00ffca-95d7-433d-bc1a-68396546d03a 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6826/2410385779,v1:172.21.15.100:6827/2410385779] [v2:172.21.15.100:6828/2410385779,v1:172.21.15.100:6829/2410385779] exists,up 87dd5e07-6deb-4214-954a-97a4336421be 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.10 up in weight 1 up_from 67 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6824/1542358432,v1:172.21.15.117:6825/1542358432] [v2:172.21.15.117:6826/1542358432,v1:172.21.15.117:6827/1542358432] exists,up bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7 2024-09-12T02:06:32.399 INFO:teuthology.orchestra.run.smithi100.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/3473203367,v1:172.21.15.189:6825/3473203367] [v2:172.21.15.189:6826/3473203367,v1:172.21.15.189:6827/3473203367] exists,up 37a8335a-5b03-425b-b336-49fb04b357ec 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.a [2,11] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.c [2,4] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 2.1c [8,11] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.17 [4,6] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.1b [4,8] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.1d [5,9] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.1e [3,9] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:pg_upmap_items 3.24 [4,9] 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/3840981165 expires 2024-09-13T01:58:21.937252+0000 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/2411453195 expires 2024-09-13T01:58:21.937252+0000 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6801/824408405 expires 2024-09-13T01:58:21.937252+0000 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6800/2932456441 expires 2024-09-13T01:57:58.286368+0000 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6800/824408405 expires 2024-09-13T01:58:21.937252+0000 2024-09-12T02:06:32.400 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:6801/2932456441 expires 2024-09-13T01:57:58.286368+0000 2024-09-12T02:06:32.401 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/1570268784 expires 2024-09-13T01:57:58.286368+0000 2024-09-12T02:06:32.401 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/1018467611 expires 2024-09-13T01:57:58.286368+0000 2024-09-12T02:06:32.401 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/3007182945 expires 2024-09-13T01:58:21.937252+0000 2024-09-12T02:06:32.401 INFO:teuthology.orchestra.run.smithi100.stdout:blocklist 172.21.15.100:0/4194493962 expires 2024-09-13T01:57:58.286368+0000 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcb900a2cc0 msgr2=0x7fcb900a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcb900a2cc0 0x7fcb900a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcba8102c60 tx=0x7fcb9c005f90 comp rx=0 tx=0).stop 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 msgr2=0x7fcba8198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8198420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009230 tx=0x7fcb98031b60 comp rx=0 tx=0).stop 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 shutdown_connections 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcb900a2cc0 0x7fcb900a5180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcba81037c0 0x7fcba819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba8102e00 0x7fcba8198420 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 --2- 172.21.15.100:0/1337368404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8101c00 0x7fcba8197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 >> 172.21.15.100:0/1337368404 conn(0x7fcba80fd390 msgr2=0x7fcba8106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:32.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 shutdown_connections 2024-09-12T02:06:32.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:32.400+0000 7fcbacc95640 1 -- 172.21.15.100:0/1337368404 wait complete. 2024-09-12T02:06:32.997 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T02:06:33.009 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:06:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:33 smithi100 ceph-mon[31179]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:33 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1337368404' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:06:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:33 smithi189 ceph-mon[35188]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:33 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1337368404' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:06:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:33 smithi117 ceph-mon[35240]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:33 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1337368404' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:06:33.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 -- 172.21.15.100:0/3668533168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584100e20 msgr2=0x7f1584101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:33.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 --2- 172.21.15.100:0/3668533168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584100e20 0x7f1584101200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1574009900 tx=0x7f157402a480 comp rx=0 tx=0).stop 2024-09-12T02:06:33.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 -- 172.21.15.100:0/3668533168 shutdown_connections 2024-09-12T02:06:33.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 --2- 172.21.15.100:0/3668533168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1584102ef0 0x7f158410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 --2- 172.21.15.100:0/3668533168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1584102570 0x7f15841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 --2- 172.21.15.100:0/3668533168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584100e20 0x7f1584101200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 -- 172.21.15.100:0/3668533168 >> 172.21.15.100:0/3668533168 conn(0x7f15840fc7d0 msgr2=0x7f15840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 -- 172.21.15.100:0/3668533168 shutdown_connections 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 -- 172.21.15.100:0/3668533168 wait complete. 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 Processor -- start 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.750+0000 7f158a816640 1 -- start start 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1584100e20 0x7f15841a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584102570 0x7f15841a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1584102ef0 0x7f158419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1584111020 con 0x7f1584102570 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1584110ea0 con 0x7f1584100e20 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15841111a0 con 0x7f1584102ef0 2024-09-12T02:06:33.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584102570 0x7f15841a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584102570 0x7f15841a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43822/0 (socket says 172.21.15.100:43822) 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 -- 172.21.15.100:0/2746126321 learned_addr learned my addr 172.21.15.100:0/2746126321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f1583fff640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1584100e20 0x7f15841a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 -- 172.21.15.100:0/2746126321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1584102ef0 msgr2=0x7f158419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1584102ef0 0x7f158419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 -- 172.21.15.100:0/2746126321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1584100e20 msgr2=0x7f15841a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1584100e20 0x7f15841a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 -- 172.21.15.100:0/2746126321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158419af80 con 0x7f1584102570 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f157bfff640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584102570 0x7f15841a0b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f156c00b4a0 tx=0x7f156c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f1581ffb640 1 -- 172.21.15.100:0/2746126321 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c014070 con 0x7f1584102570 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158419b270 con 0x7f1584102570 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f1581ffb640 1 -- 172.21.15.100:0/2746126321 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f156c010af0 con 0x7f1584102570 2024-09-12T02:06:33.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f1581ffb640 1 -- 172.21.15.100:0/2746126321 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c017d10 con 0x7f1584102570 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.751+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15841a75e0 con 0x7f1584102570 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.752+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15841021b0 con 0x7f1584102570 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.753+0000 7f1581ffb640 1 -- 172.21.15.100:0/2746126321 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f156c017070 con 0x7f1584102570 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.754+0000 7f1581ffb640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f15700a2c10 0x7f15700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.754+0000 7f1583fff640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f15700a2c10 0x7f15700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.755+0000 7f1581ffb640 1 -- 172.21.15.100:0/2746126321 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f156c0ce530 con 0x7f1584102570 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.755+0000 7f1583fff640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f15700a2c10 0x7f15700a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1574005ab0 tx=0x7f1574005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:33.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.759+0000 7f1581ffb640 1 -- 172.21.15.100:0/2746126321 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f156c09b450 con 0x7f1584102570 2024-09-12T02:06:33.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.960+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15841a77b0 con 0x7f1584102570 2024-09-12T02:06:33.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.960+0000 7f1581ffb640 1 -- 172.21.15.100:0/2746126321 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11929 (secure 0 0 0) 0x7f156c09ad50 con 0x7f1584102570 2024-09-12T02:06:33.961 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:33.961 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"btime":"2024-09-12T02:05:19:082439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:05:18.350451+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24433,24428]},"id":1}]} 2024-09-12T02:06:33.961 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-12T02:06:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f15700a2c10 msgr2=0x7f15700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f15700a2c10 0x7f15700a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1574005ab0 tx=0x7f1574005a20 comp rx=0 tx=0).stop 2024-09-12T02:06:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584102570 msgr2=0x7f15841a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584102570 0x7f15841a0b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f156c00b4a0 tx=0x7f156c00b960 comp rx=0 tx=0).stop 2024-09-12T02:06:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 shutdown_connections 2024-09-12T02:06:33.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f15700a2c10 0x7f15700a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1584102ef0 0x7f158419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1584102570 0x7f15841a0b30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 --2- 172.21.15.100:0/2746126321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1584100e20 0x7f15841a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 >> 172.21.15.100:0/2746126321 conn(0x7f15840fc7d0 msgr2=0x7f158406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 shutdown_connections 2024-09-12T02:06:33.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:33.963+0000 7f158a816640 1 -- 172.21.15.100:0/2746126321 wait complete. 2024-09-12T02:06:34.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:34 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2746126321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:34.579 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:06:34.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:34 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2746126321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:34.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:34 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2746126321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:34.823 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.298+0000 7f987cdbf640 1 -- 172.21.15.100:0/1146676398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 msgr2=0x7f987810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.298+0000 7f987cdbf640 1 --2- 172.21.15.100:0/1146676398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987810da40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9870009900 tx=0x7f987002a480 comp rx=0 tx=0).stop 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 -- 172.21.15.100:0/1146676398 shutdown_connections 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 --2- 172.21.15.100:0/1146676398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987810da40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 --2- 172.21.15.100:0/1146676398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9878102570 0x7f98781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 --2- 172.21.15.100:0/1146676398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9878100e20 0x7f9878101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 -- 172.21.15.100:0/1146676398 >> 172.21.15.100:0/1146676398 conn(0x7f98780fc7d0 msgr2=0x7f98780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 -- 172.21.15.100:0/1146676398 shutdown_connections 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 -- 172.21.15.100:0/1146676398 wait complete. 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 Processor -- start 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.299+0000 7f987cdbf640 1 -- start start 2024-09-12T02:06:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9878100e20 0x7f98781a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9878102570 0x7f98781a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9878111020 con 0x7f9878102ef0 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9878110ea0 con 0x7f9878100e20 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98781111a0 con 0x7f9878102570 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43834/0 (socket says 172.21.15.100:43834) 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 -- 172.21.15.100:0/877515151 learned_addr learned my addr 172.21.15.100:0/877515151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987659c640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9878100e20 0x7f98781a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9875d9b640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9878102570 0x7f98781a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 -- 172.21.15.100:0/877515151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9878102570 msgr2=0x7f98781a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9878102570 0x7f98781a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 -- 172.21.15.100:0/877515151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9878100e20 msgr2=0x7f98781a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9878100e20 0x7f98781a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 -- 172.21.15.100:0/877515151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987819aea0 con 0x7f9878102ef0 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9875d9b640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9878102570 0x7f98781a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f9876d9d640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987819a630 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9870005ab0 tx=0x7f9870003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f986f7fe640 1 -- 172.21.15.100:0/877515151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987003f070 con 0x7f9878102ef0 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f986f7fe640 1 -- 172.21.15.100:0/877515151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9870031e30 con 0x7f9878102ef0 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f986f7fe640 1 -- 172.21.15.100:0/877515151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870035030 con 0x7f9878102ef0 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987819b130 con 0x7f9878102ef0 2024-09-12T02:06:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.300+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98781a7310 con 0x7f9878102ef0 2024-09-12T02:06:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.302+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98781021b0 con 0x7f9878102ef0 2024-09-12T02:06:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.303+0000 7f986f7fe640 1 -- 172.21.15.100:0/877515151 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9870042070 con 0x7f9878102ef0 2024-09-12T02:06:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.303+0000 7f986f7fe640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98640a2c10 0x7f98640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.303+0000 7f987659c640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98640a2c10 0x7f98640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.303+0000 7f986f7fe640 1 -- 172.21.15.100:0/877515151 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f98700efb00 con 0x7f9878102ef0 2024-09-12T02:06:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.304+0000 7f987659c640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98640a2c10 0x7f98640a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9868009f20 tx=0x7f98680094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:35.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.307+0000 7f986f7fe640 1 -- 172.21.15.100:0/877515151 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9870003e20 con 0x7f9878102ef0 2024-09-12T02:06:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.507+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98781a75a0 con 0x7f9878102ef0 2024-09-12T02:06:35.507 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:35 smithi100 ceph-mon[31179]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:35.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.507+0000 7f986f7fe640 1 -- 172.21.15.100:0/877515151 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11929 (secure 0 0 0) 0x7f98700bc910 con 0x7f9878102ef0 2024-09-12T02:06:35.508 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:35.508 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"btime":"2024-09-12T02:05:19:082439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:05:18.350451+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24433,24428]},"id":1}]} 2024-09-12T02:06:35.508 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-12T02:06:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98640a2c10 msgr2=0x7f98640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98640a2c10 0x7f98640a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9868009f20 tx=0x7f98680094f0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 msgr2=0x7f987819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987819a630 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9870005ab0 tx=0x7f9870003c30 comp rx=0 tx=0).stop 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 shutdown_connections 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f98640a2c10 0x7f98640a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9878102ef0 0x7f987819a630 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9878102570 0x7f98781a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 --2- 172.21.15.100:0/877515151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9878100e20 0x7f98781a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 >> 172.21.15.100:0/877515151 conn(0x7f98780fc7d0 msgr2=0x7f98780ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 shutdown_connections 2024-09-12T02:06:35.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:35.509+0000 7f987cdbf640 1 -- 172.21.15.100:0/877515151 wait complete. 2024-09-12T02:06:35.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:35 smithi189 ceph-mon[35188]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:35.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:35 smithi117 ceph-mon[35240]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:36.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:06:36.416 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:36.536 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:36 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/877515151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:36.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:36 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/877515151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:36.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:36 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/877515151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:36.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 -- 172.21.15.100:0/4170422013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0106a60 msgr2=0x7f9ef0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 --2- 172.21.15.100:0/4170422013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0106a60 0x7f9ef0106e40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009930 tx=0x7f9ee002a420 comp rx=0 tx=0).stop 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 -- 172.21.15.100:0/4170422013 shutdown_connections 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 --2- 172.21.15.100:0/4170422013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ef0101400 0x7f9ef010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 --2- 172.21.15.100:0/4170422013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ef0100a60 0x7f9ef0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 --2- 172.21.15.100:0/4170422013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0106a60 0x7f9ef0106e40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 -- 172.21.15.100:0/4170422013 >> 172.21.15.100:0/4170422013 conn(0x7f9ef00fc780 msgr2=0x7f9ef00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 -- 172.21.15.100:0/4170422013 shutdown_connections 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.880+0000 7f9ef529a640 1 -- 172.21.15.100:0/4170422013 wait complete. 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 Processor -- start 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 -- start start 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0100a60 0x7f9ef01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ef0101400 0x7f9ef0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ef0106a60 0x7f9ef019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef0110e80 con 0x7f9ef0100a60 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef0110d00 con 0x7f9ef0101400 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ef529a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef0111000 con 0x7f9ef0106a60 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0100a60 0x7f9ef01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0100a60 0x7f9ef01984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43854/0 (socket says 172.21.15.100:43854) 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 -- 172.21.15.100:0/237524490 learned_addr learned my addr 172.21.15.100:0/237524490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9ee7fff640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ef0101400 0x7f9ef0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eef7fe640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ef0106a60 0x7f9ef019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 -- 172.21.15.100:0/237524490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ef0106a60 msgr2=0x7f9ef019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ef0106a60 0x7f9ef019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 -- 172.21.15.100:0/237524490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ef0101400 msgr2=0x7f9ef0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:36.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ef0101400 0x7f9ef0198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eeeffd640 1 -- 172.21.15.100:0/237524490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef019d4a0 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.881+0000 7f9eef7fe640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ef0106a60 0x7f9ef019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.882+0000 7f9eeeffd640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0100a60 0x7f9ef01984f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009230 tx=0x7f9ee0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.882+0000 7f9eecff9640 1 -- 172.21.15.100:0/237524490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee003f030 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.882+0000 7f9eecff9640 1 -- 172.21.15.100:0/237524490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee0003ad0 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.882+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef019d730 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.882+0000 7f9eecff9640 1 -- 172.21.15.100:0/237524490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0035070 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.882+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef01a5070 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.883+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef0100ec0 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.884+0000 7f9eecff9640 1 -- 172.21.15.100:0/237524490 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9ee0042030 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.884+0000 7f9eecff9640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9edc0a2c90 0x7f9edc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.885+0000 7f9ee7fff640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9edc0a2c90 0x7f9edc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.885+0000 7f9eecff9640 1 -- 172.21.15.100:0/237524490 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9ee00ef650 con 0x7f9ef0100a60 2024-09-12T02:06:36.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.885+0000 7f9ee7fff640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9edc0a2c90 0x7f9edc0a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ef01051b0 tx=0x7f9ed800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:36.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:36.889+0000 7f9eecff9640 1 -- 172.21.15.100:0/237524490 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ee00bc460 con 0x7f9ef0100a60 2024-09-12T02:06:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.055+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ef0109fe0 con 0x7f9ef0100a60 2024-09-12T02:06:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.056+0000 7f9eecff9640 1 -- 172.21.15.100:0/237524490 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7f9ee00bbd60 con 0x7f9ef0100a60 2024-09-12T02:06:37.056 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:37.057 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9edc0a2c90 msgr2=0x7f9edc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9edc0a2c90 0x7f9edc0a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ef01051b0 tx=0x7f9ed800b390 comp rx=0 tx=0).stop 2024-09-12T02:06:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0100a60 msgr2=0x7f9ef01984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0100a60 0x7f9ef01984f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009230 tx=0x7f9ee0004270 comp rx=0 tx=0).stop 2024-09-12T02:06:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 shutdown_connections 2024-09-12T02:06:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9edc0a2c90 0x7f9edc0a5150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ef0106a60 0x7f9ef019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ef0101400 0x7f9ef0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 --2- 172.21.15.100:0/237524490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ef0100a60 0x7f9ef01984f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 >> 172.21.15.100:0/237524490 conn(0x7f9ef00fc780 msgr2=0x7f9ef006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 shutdown_connections 2024-09-12T02:06:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:37.058+0000 7f9ef529a640 1 -- 172.21.15.100:0/237524490 wait complete. 2024-09-12T02:06:37.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:37 smithi100 ceph-mon[31179]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:37.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:37 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/237524490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:37 smithi189 ceph-mon[35188]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:37 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/237524490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:37 smithi117 ceph-mon[35240]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:37 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/237524490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:37.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:05:07.550581+0000', 'modified': '2024-09-12T02:05:18.350451+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24452, 'mds_1': 24433, 'mds_2': 24428}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24410': {'gid': 24410, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3915021752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3915021752}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3915021752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/2566860695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 2566860695}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 2566860695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/3569067822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 3569067822}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 3569067822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.117:6837/137176693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 137176693}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 137176693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/2548139728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2548139728}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2548139728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6839/3211661343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 3211661343}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 3211661343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24452, 'qdb_cluster': [24452, 24433, 24428]} 2024-09-12T02:06:37.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:06:37.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:06:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:38.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 -- 172.21.15.100:0/3963970455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 msgr2=0x7f7f9c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3963970455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c10d950 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009cd0 tx=0x7f7f9402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 -- 172.21.15.100:0/3963970455 shutdown_connections 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3963970455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c10d950 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3963970455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f9c100a80 0x7f7f9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3963970455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f9c106a80 0x7f7f9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 -- 172.21.15.100:0/3963970455 >> 172.21.15.100:0/3963970455 conn(0x7f7f9c0fc7a0 msgr2=0x7f7f9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 -- 172.21.15.100:0/3963970455 shutdown_connections 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.420+0000 7f7fa395d640 1 -- 172.21.15.100:0/3963970455 wait complete. 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 Processor -- start 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 -- start start 2024-09-12T02:06:38.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f9c100a80 0x7f7f9c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f9c106a80 0x7f7f9c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c110ea0 con 0x7f7f9c101420 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c110d20 con 0x7f7f9c100a80 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c111020 con 0x7f7f9c106a80 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43870/0 (socket says 172.21.15.100:43870) 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3507635016 learned_addr learned my addr 172.21.15.100:0/3507635016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f9c100a80 0x7f7f9c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3507635016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f9c106a80 msgr2=0x7f7f9c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f9c106a80 0x7f7f9c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3507635016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f9c100a80 msgr2=0x7f7f9c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f9c100a80 0x7f7f9c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3507635016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c19d380 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f9c100a80 0x7f7f9c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c198910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000c920 tx=0x7f7f9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7f8e7fc640 1 -- 172.21.15.100:0/3507635016 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90007c70 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7f8e7fc640 1 -- 172.21.15.100:0/3507635016 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90007e10 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c19d670 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.421+0000 7f7f8e7fc640 1 -- 172.21.15.100:0/3507635016 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90018890 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.422+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c1a4f50 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.423+0000 7f7f8e7fc640 1 -- 172.21.15.100:0/3507635016 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7f90018a70 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.424+0000 7f7fa5d36740 1 Processor -- start 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.424+0000 7f7fa5d36740 1 -- start start 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.424+0000 7f7f8e7fc640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f880a2c90 0x7f7f880a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.424+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f880a2c90 0x7f7f880a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.424+0000 7f7f8e7fc640 1 -- 172.21.15.100:0/3507635016 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f900cf3f0 con 0x7f7f9c101420 2024-09-12T02:06:38.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372453f50 0x563372452870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x5633724531f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x563372468640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5633723b9090 con 0x563372466250 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563372360a70 con 0x563372452db0 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5633723b5050 con 0x563372453f50 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa1efa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x563372468640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa0ef8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x5633724531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa16f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372453f50 0x563372452870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa1efa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x563372468640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43872/0 (socket says 172.21.15.100:43872) 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa1efa640 1 -- 172.21.15.100:0/3735329461 learned_addr learned my addr 172.21.15.100:0/3735329461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f880a2c90 0x7f7f880a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7f940315f0 tx=0x7f7f94031620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3735329461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372453f50 msgr2=0x563372452870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372453f50 0x563372452870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3735329461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 msgr2=0x563372468640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x563372468640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3735329461 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56337236d130 con 0x563372452db0 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x563372468640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372453f50 0x563372452870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x5633724531f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ccd20 tx=0x7f7f9009b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28399b0f1b2c477 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7f877fe640 1 -- 172.21.15.100:0/3735329461 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900b3020 con 0x563372452db0 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7f877fe640 1 -- 172.21.15.100:0/3735329461 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90099da0 con 0x563372452db0 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.425+0000 7f7f877fe640 1 -- 172.21.15.100:0/3735329461 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90098110 con 0x563372452db0 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3735329461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 msgr2=0x5633724531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x5633724531f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ccd20 tx=0x7f7f9009b710 comp rx=0 tx=0).stop 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3735329461 shutdown_connections 2024-09-12T02:06:38.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x563372468640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x5633724531f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3735329461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372453f50 0x563372452870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3735329461 >> 172.21.15.100:0/3735329461 conn(0x56337244ef60 msgr2=0x56337244f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3735329461 shutdown_connections 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.426+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3735329461 wait complete. 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 -- start start 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 Processor -- start 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372458ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x563372456390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x5633724568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563372468f80 con 0x563372453f50 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563372373f20 con 0x563372452db0 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563372469100 con 0x563372466250 2024-09-12T02:06:38.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa5d36740 10 client.0 _ll_register_callbacks cb 0x56337233d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x563372456390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x563372456390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43880/0 (socket says 172.21.15.100:43880) 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/1276179839 learned_addr learned my addr 172.21.15.100:0/1276179839 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372458ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/1276179839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 msgr2=0x5633724568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x5633724568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x5633724568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 msgr2=0x563372458ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372458ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/1276179839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337212a2b0 con 0x563372453f50 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.427+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372458ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x563372456390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7f900cccf0 tx=0x7f7f90020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5508904f7653c34d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7f84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7f84ff9640 1 -- 172.21.15.100:0/1276179839 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9007e070 con 0x563372453f50 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7f84ff9640 1 -- 172.21.15.100:0/1276179839 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f90018d60 con 0x563372453f50 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f90099da0 con 0x563372453f50 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7f84ff9640 1 -- 172.21.15.100:0/1276179839 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7f900ba050 con 0x563372453f50 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 10 client.15078 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x563372474970 con 0x563372453f50 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7f84ff9640 1 -- 172.21.15.100:0/1276179839 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90099da0 con 0x563372453f50 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7f84ff9640 1 -- 172.21.15.100:0/1276179839 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f7f9009aef0 con 0x563372453f50 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 10 client.15078 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 20 client.15078 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x563372475cc0 0x563372477e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 4 client.15078 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.428+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633723c6600 con 0x563372475cc0 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.429+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x563372475cc0 0x563372477e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.429+0000 7f7f84ff9640 10 client.15078 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.429+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x563372475cc0 0x563372477e40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6e05610e8e700d0 server_cookie=a7de079724133007 in_seq=0 out_seq=0 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7f84ff9640 1 -- 172.21.15.100:0/1276179839 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633723c6600 con 0x563372475cc0 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7f84ff9640 10 client.15078 handle_command_reply: tid=0 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 client.15078 shutdown 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 msgr2=0x563372456390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x563372456390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7f900cccf0 tx=0x7f7f90020000 comp rx=0 tx=0).stop 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 shutdown_connections 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x563372475cc0 0x563372477e40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x5633724568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x563372456390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7f84ff9640 0 client.15078 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:38.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/1276179839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372458ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 >> 172.21.15.100:0/1276179839 conn(0x56337244ef60 msgr2=0x563372454c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 shutdown_connections 2024-09-12T02:06:38.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 1 -- 172.21.15.100:0/1276179839 wait complete. 2024-09-12T02:06:38.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.430+0000 7f7fa5d36740 20 client.15078 trim_cache size 0 max 16384 2024-09-12T02:06:38.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 Processor -- start 2024-09-12T02:06:38.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 -- start start 2024-09-12T02:06:38.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372452db0 0x563372477e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372453f50 0x563372452750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x56337244e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563372476180 con 0x563372466250 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563372476850 con 0x563372453f50 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.447+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563372476f20 con 0x563372452db0 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x56337244e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x56337244e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43892/0 (socket says 172.21.15.100:43892) 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 -- 172.21.15.100:0/4112839184 learned_addr learned my addr 172.21.15.100:0/4112839184 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372453f50 0x563372452750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372452db0 0x563372477e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 -- 172.21.15.100:0/4112839184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372452db0 msgr2=0x563372477e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372452db0 0x563372477e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 -- 172.21.15.100:0/4112839184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372453f50 msgr2=0x563372452750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372453f50 0x563372452750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 -- 172.21.15.100:0/4112839184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633724537c0 con 0x563372466250 2024-09-12T02:06:38.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x56337244e5d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7f940314e0 tx=0x7f7f94048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df28101401f7c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7f86ffd640 1 -- 172.21.15.100:0/4112839184 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f94004240 con 0x563372466250 2024-09-12T02:06:38.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7f86ffd640 1 -- 172.21.15.100:0/4112839184 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f94036040 con 0x563372466250 2024-09-12T02:06:38.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.448+0000 7f7f86ffd640 1 -- 172.21.15.100:0/4112839184 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f94030ec0 con 0x563372466250 2024-09-12T02:06:38.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 -- 172.21.15.100:0/4112839184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 msgr2=0x56337244e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x56337244e5d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7f940314e0 tx=0x7f7f94048000 comp rx=0 tx=0).stop 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 -- 172.21.15.100:0/4112839184 shutdown_connections 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372466250 0x56337244e5d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372453f50 0x563372452750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/4112839184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372452db0 0x563372477e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 -- 172.21.15.100:0/4112839184 >> 172.21.15.100:0/4112839184 conn(0x56337244ef60 msgr2=0x563372462230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 -- 172.21.15.100:0/4112839184 shutdown_connections 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 -- 172.21.15.100:0/4112839184 wait complete. 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 -- start start 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.449+0000 7f7fa5d36740 1 Processor -- start 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372467190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x5633724676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x563372467c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563372477cc0 con 0x563372453f50 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5633724775f0 con 0x563372452db0 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563372478390 con 0x563372466250 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 10 client.0 _ll_register_callbacks cb 0x7f7f94009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x5633724676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x5633724676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43900/0 (socket says 172.21.15.100:43900) 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3407677227 learned_addr learned my addr 172.21.15.100:0/3407677227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372467190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x563372467c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3407677227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 msgr2=0x563372467c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x563372467c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 msgr2=0x563372467190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372467190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 -- 172.21.15.100:0/3407677227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337247c6d0 con 0x563372453f50 2024-09-12T02:06:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa1efa640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x563372467c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa0ef8640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x5633724676d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f9009b290 tx=0x7f7f90000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdc8a6e08990b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7f84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7f84ff9640 1 -- 172.21.15.100:0/3407677227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9007e070 con 0x563372453f50 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7f84ff9640 1 -- 172.21.15.100:0/3407677227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f900a4280 con 0x563372453f50 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.450+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f94036040 con 0x563372453f50 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7f84ff9640 1 -- 172.21.15.100:0/3407677227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7f900b3070 con 0x563372453f50 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 10 client.15084 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56337247c6d0 con 0x563372453f50 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7f84ff9640 1 -- 172.21.15.100:0/3407677227 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f94036040 con 0x563372453f50 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7f84ff9640 1 -- 172.21.15.100:0/3407677227 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f7f900a0fe0 con 0x563372453f50 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 10 client.15084 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 10 client.15084 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:06:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 20 client.15084 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5633724e5b60 0x5633724e4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 4 client.15084 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "status"}) -- 0x5633723c0b10 con 0x5633724e5b60 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.451+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5633724e5b60 0x5633724e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7f84ff9640 10 client.15084 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa16f9640 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5633724e5b60 0x5633724e4870 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a165819d98c181c server_cookie=eeaa8d24c38a40ff in_seq=0 out_seq=0 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7f84ff9640 1 -- 172.21.15.100:0/3407677227 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5633723c0b10 con 0x5633724e5b60 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7f84ff9640 10 client.15084 handle_command_reply: tid=0 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 client.15084 shutdown 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 msgr2=0x5633724676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x5633724676d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f9009b290 tx=0x7f7f90000bc0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 shutdown_connections 2024-09-12T02:06:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5633724e5b60 0x5633724e4870 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563372466250 0x563372467c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563372453f50 0x5633724676d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 --2- 172.21.15.100:0/3407677227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563372452db0 0x563372467190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7f84ff9640 0 client.15084 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 >> 172.21.15.100:0/3407677227 conn(0x56337244ef60 msgr2=0x563372454460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 shutdown_connections 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 1 -- 172.21.15.100:0/3407677227 wait complete. 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.452+0000 7f7fa5d36740 20 client.15084 trim_cache size 0 max 16384 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:06:38.458 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24428, 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 82.368526623999998, 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 23, 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 112.990574255 2024-09-12T02:06:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f880a2c90 msgr2=0x7f7f880a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f880a2c90 0x7f7f880a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7f940315f0 tx=0x7f7f94031620 comp rx=0 tx=0).stop 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 msgr2=0x7f7f9c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c198910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000c920 tx=0x7f7f9000cde0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 shutdown_connections 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7f880a2c90 0x7f7f880a5150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f9c106a80 0x7f7f9c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c101420 0x7f7f9c198910 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 --2- 172.21.15.100:0/3507635016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f9c100a80 0x7f7f9c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:38.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 >> 172.21.15.100:0/3507635016 conn(0x7f7f9c0fc7a0 msgr2=0x7f7f9c104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:38.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 shutdown_connections 2024-09-12T02:06:38.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:38.453+0000 7f7fa395d640 1 -- 172.21.15.100:0/3507635016 wait complete. 2024-09-12T02:06:39.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:06:39.364 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:39.482 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:39 smithi100 ceph-mon[31179]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:39 smithi189 ceph-mon[35188]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:39 smithi117 ceph-mon[35240]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.805+0000 7f097021c640 1 -- 172.21.15.100:0/2002909485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102ef0 msgr2=0x7f096810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.805+0000 7f097021c640 1 --2- 172.21.15.100:0/2002909485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102ef0 0x7f096810da40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0960009ca0 tx=0x7f096002a950 comp rx=0 tx=0).stop 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.805+0000 7f097021c640 1 -- 172.21.15.100:0/2002909485 shutdown_connections 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.805+0000 7f097021c640 1 --2- 172.21.15.100:0/2002909485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102ef0 0x7f096810da40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.805+0000 7f097021c640 1 --2- 172.21.15.100:0/2002909485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0968102570 0x7f09681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.805+0000 7f097021c640 1 --2- 172.21.15.100:0/2002909485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0968100e20 0x7f0968101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.805+0000 7f097021c640 1 -- 172.21.15.100:0/2002909485 >> 172.21.15.100:0/2002909485 conn(0x7f09680fc7d0 msgr2=0x7f09680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 -- 172.21.15.100:0/2002909485 shutdown_connections 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 -- 172.21.15.100:0/2002909485 wait complete. 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 Processor -- start 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 -- start start 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0968100e20 0x7f0968197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102570 0x7f0968197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0968102ef0 0x7f096819bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0968110f80 con 0x7f0968102570 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0968110e00 con 0x7f0968100e20 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f097021c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0968111100 con 0x7f0968102ef0 2024-09-12T02:06:39.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.806+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102570 0x7f0968197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102570 0x7f0968197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43920/0 (socket says 172.21.15.100:43920) 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 -- 172.21.15.100:0/396983516 learned_addr learned my addr 172.21.15.100:0/396983516 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096dfb8640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0968100e20 0x7f0968197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096e7b9640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0968102ef0 0x7f096819bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 -- 172.21.15.100:0/396983516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0968102ef0 msgr2=0x7f096819bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0968102ef0 0x7f096819bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 -- 172.21.15.100:0/396983516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0968100e20 msgr2=0x7f0968197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0968100e20 0x7f0968197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 -- 172.21.15.100:0/396983516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096819c2b0 con 0x7f0968102570 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f096d7b7640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102570 0x7f0968197840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f095800c920 tx=0x7f095800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f095effd640 1 -- 172.21.15.100:0/396983516 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958007c70 con 0x7f0968102570 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096819c5a0 con 0x7f0968102570 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f095effd640 1 -- 172.21.15.100:0/396983516 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0958007e10 con 0x7f0968102570 2024-09-12T02:06:39.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f095effd640 1 -- 172.21.15.100:0/396983516 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958018890 con 0x7f0968102570 2024-09-12T02:06:39.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.807+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09681a3e80 con 0x7f0968102570 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f095effd640 1 -- 172.21.15.100:0/396983516 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0958018a70 con 0x7f0968102570 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 Processor -- start 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 -- start start 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b2870 0x55952e5b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b3190 0x55952e5bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bfdc0 0x55952e5c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55952e519090 con 0x55952e5bfdc0 2024-09-12T02:06:39.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55952e4c0a70 con 0x55952e5b2870 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.810+0000 7f09725f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55952e515050 con 0x55952e5b3190 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bfdc0 0x55952e5c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096dfb8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b3190 0x55952e5bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096dfb8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b3190 0x55952e5bf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:35718/0 (socket says 172.21.15.100:35718) 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bfdc0 0x55952e5c21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43928/0 (socket says 172.21.15.100:43928) 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096dfb8640 1 -- 172.21.15.100:0/1587835423 learned_addr learned my addr 172.21.15.100:0/1587835423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f095effd640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09540a2c10 0x7f09540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096e7b9640 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b2870 0x55952e5b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f095effd640 1 -- 172.21.15.100:0/396983516 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09580cf370 con 0x7f0968102570 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 -- 172.21.15.100:0/1587835423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b3190 msgr2=0x55952e5bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b3190 0x55952e5bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 -- 172.21.15.100:0/1587835423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b2870 msgr2=0x55952e5b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096e7b9640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09540a2c10 0x7f09540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b2870 0x55952e5b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 -- 172.21.15.100:0/1587835423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55952e4cd130 con 0x55952e5bfdc0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096dfb8640 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b3190 0x55952e5bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.811+0000 7f096d7b7640 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bfdc0 0x55952e5c21b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f09580cccd0 tx=0x7f095800ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75a1b445c035cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.812+0000 7f0953fff640 1 -- 172.21.15.100:0/1587835423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095809c120 con 0x55952e5bfdc0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.812+0000 7f0953fff640 1 -- 172.21.15.100:0/1587835423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f095809ba20 con 0x55952e5bfdc0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.812+0000 7f0953fff640 1 -- 172.21.15.100:0/1587835423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09580ccf20 con 0x55952e5bfdc0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.812+0000 7f096e7b9640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09540a2c10 0x7f09540a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0960009430 tx=0x7f096002a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 -- 172.21.15.100:0/1587835423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bfdc0 msgr2=0x55952e5c21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bfdc0 0x55952e5c21b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f09580cccd0 tx=0x7f095800ff30 comp rx=0 tx=0).stop 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 -- 172.21.15.100:0/1587835423 shutdown_connections 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bfdc0 0x55952e5c21b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b3190 0x55952e5bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 --2- 172.21.15.100:0/1587835423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b2870 0x55952e5b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 -- 172.21.15.100:0/1587835423 >> 172.21.15.100:0/1587835423 conn(0x55952e5aef60 msgr2=0x55952e5af340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 -- 172.21.15.100:0/1587835423 shutdown_connections 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 -- 172.21.15.100:0/1587835423 wait complete. 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 -- start start 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.813+0000 7f09725f5740 1 Processor -- start 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f09725f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f09725f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b3190 0x55952e5bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f09725f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bd5e0 0x55952e5cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f09725f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55952e5c2990 con 0x55952e5bd5e0 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f09725f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55952e4d3f20 con 0x55952e5b3190 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f09725f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55952e5c2b10 con 0x55952e5b2870 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f09725f5740 10 client.0 _ll_register_callbacks cb 0x55952e49d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f096e7b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bd5e0 0x55952e5cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f096e7b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bd5e0 0x55952e5cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43930/0 (socket says 172.21.15.100:43930) 2024-09-12T02:06:39.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f096e7b9640 1 -- 172.21.15.100:0/2264568839 learned_addr learned my addr 172.21.15.100:0/2264568839 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f096dfb8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.814+0000 7f096d7b7640 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b3190 0x55952e5bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f096e7b9640 1 -- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 msgr2=0x55952e5bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f096e7b9640 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f096e7b9640 1 -- 172.21.15.100:0/2264568839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b3190 msgr2=0x55952e5bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f096e7b9640 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b3190 0x55952e5bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f096e7b9640 1 -- 172.21.15.100:0/2264568839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55952e28a2b0 con 0x55952e5bd5e0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f096dfb8640 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f096e7b9640 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bd5e0 0x55952e5cbe70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f096002fe90 tx=0x7f0960005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b38e3575ad3138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09517fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09517fa640 1 -- 172.21.15.100:0/2264568839 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960034040 con 0x55952e5bd5e0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09517fa640 1 -- 172.21.15.100:0/2264568839 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0960030bd0 con 0x55952e5bd5e0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f095809ba20 con 0x55952e5bd5e0 2024-09-12T02:06:39.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09517fa640 1 -- 172.21.15.100:0/2264568839 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0960030dd0 con 0x55952e5bd5e0 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09725f5740 10 client.15096 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55952e5ce930 con 0x55952e5bd5e0 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.815+0000 7f09517fa640 1 -- 172.21.15.100:0/2264568839 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f095809ba20 con 0x55952e5bd5e0 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09517fa640 1 -- 172.21.15.100:0/2264568839 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f096003a430 con 0x55952e5bd5e0 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09725f5740 10 client.15096 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09725f5740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09725f5740 20 client.15096 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09725f5740 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e5d0f50 0x55952e5d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09725f5740 4 client.15096 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55952e526600 con 0x55952e5d0f50 2024-09-12T02:06:39.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f096dfb8640 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e5d0f50 0x55952e5d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f096dfb8640 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e5d0f50 0x55952e5d23c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18b349876273f2a8 server_cookie=afcbf0e52d3b92b5 in_seq=0 out_seq=0 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.816+0000 7f09517fa640 10 client.15096 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09517fa640 1 -- 172.21.15.100:0/2264568839 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55952e526600 con 0x55952e5d0f50 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09517fa640 10 client.15096 handle_command_reply: tid=0 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 client.15096 shutdown 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bd5e0 msgr2=0x55952e5cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bd5e0 0x55952e5cbe70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f096002fe90 tx=0x7f0960005ef0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 shutdown_connections 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5bd5e0 0x55952e5cbe70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5b3190 0x55952e5bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e5d0f50 0x55952e5d23c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 --2- 172.21.15.100:0/2264568839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 >> 172.21.15.100:0/2264568839 conn(0x55952e5aef60 msgr2=0x55952e5b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.817+0000 7f09517fa640 0 client.15096 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:39.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.818+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 shutdown_connections 2024-09-12T02:06:39.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.818+0000 7f09725f5740 1 -- 172.21.15.100:0/2264568839 wait complete. 2024-09-12T02:06:39.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.818+0000 7f09725f5740 20 client.15096 trim_cache size 0 max 16384 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 Processor -- start 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 -- start start 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55952e5d0700 con 0x55952e5b3190 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55952e5d0dd0 con 0x55952e5bd5e0 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f09725f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55952e5d14a0 con 0x55952e5b2870 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43944/0 (socket says 172.21.15.100:43944) 2024-09-12T02:06:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 -- 172.21.15.100:0/4206085882 learned_addr learned my addr 172.21.15.100:0/4206085882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096e7b9640 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096dfb8640 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 -- 172.21.15.100:0/4206085882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 msgr2=0x55952e5cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 -- 172.21.15.100:0/4206085882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 msgr2=0x55952e5ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.835+0000 7f096d7b7640 1 -- 172.21.15.100:0/4206085882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55952e5d1950 con 0x55952e5b3190 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f096e7b9640 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f096d7b7640 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b9dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0958099cd0 tx=0x7f0958000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d7cadb35316781 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09537fe640 1 -- 172.21.15.100:0/4206085882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09580b3070 con 0x55952e5b3190 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09537fe640 1 -- 172.21.15.100:0/4206085882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f095809fdd0 con 0x55952e5b3190 2024-09-12T02:06:39.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09537fe640 1 -- 172.21.15.100:0/4206085882 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958098090 con 0x55952e5b3190 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 -- 172.21.15.100:0/4206085882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 msgr2=0x55952e5b9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b9dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0958099cd0 tx=0x7f0958000bc0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 -- 172.21.15.100:0/4206085882 shutdown_connections 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b9dc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 --2- 172.21.15.100:0/4206085882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 -- 172.21.15.100:0/4206085882 >> 172.21.15.100:0/4206085882 conn(0x55952e5aef60 msgr2=0x55952e5bb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 -- 172.21.15.100:0/4206085882 shutdown_connections 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.836+0000 7f09725f5740 1 -- 172.21.15.100:0/4206085882 wait complete. 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 -- start start 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 Processor -- start 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55952e5d2240 con 0x55952e5b3190 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55952e5d1b70 con 0x55952e5bd5e0 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55952e5d2910 con 0x55952e5b2870 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f09725f5740 10 client.0 _ll_register_callbacks cb 0x7f09600099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f096d7b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43950/0 (socket says 172.21.15.100:43950) 2024-09-12T02:06:39.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.837+0000 7f096d7b7640 1 -- 172.21.15.100:0/3681883647 learned_addr learned my addr 172.21.15.100:0/3681883647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096e7b9640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096dfb8640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096d7b7640 1 -- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 msgr2=0x55952e5b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096d7b7640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096d7b7640 1 -- 172.21.15.100:0/3681883647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 msgr2=0x55952e5b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096d7b7640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096d7b7640 1 -- 172.21.15.100:0/3681883647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55952e5d9790 con 0x55952e5b3190 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096e7b9640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f096d7b7640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b6f80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f095809b720 tx=0x7f09580982c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c024353811cf815 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09517fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09517fa640 1 -- 172.21.15.100:0/3681883647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09580b3070 con 0x55952e5b3190 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09517fa640 1 -- 172.21.15.100:0/3681883647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09580ccf20 con 0x55952e5b3190 2024-09-12T02:06:39.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f095809fdd0 con 0x55952e5b3190 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09517fa640 1 -- 172.21.15.100:0/3681883647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f095809c120 con 0x55952e5b3190 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09725f5740 10 client.15102 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55952e5daa00 con 0x55952e5b3190 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09517fa640 1 -- 172.21.15.100:0/3681883647 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f095809fdd0 con 0x55952e5b3190 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09517fa640 1 -- 172.21.15.100:0/3681883647 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f09580a4200 con 0x55952e5b3190 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.838+0000 7f09725f5740 10 client.15102 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09725f5740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09725f5740 20 client.15102 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09725f5740 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e645710 0x55952e644420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09725f5740 4 client.15102 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "status"}) -- 0x55952e520b10 con 0x55952e645710 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f096dfb8640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e645710 0x55952e644420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09517fa640 10 client.15102 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:39.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f096dfb8640 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e645710 0x55952e644420 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88429d1779a6c69b server_cookie=6d08856560bb37ed in_seq=0 out_seq=0 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09517fa640 1 -- 172.21.15.100:0/3681883647 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55952e520b10 con 0x55952e645710 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09517fa640 10 client.15102 handle_command_reply: tid=0 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.839+0000 7f09725f5740 1 client.15102 shutdown 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 msgr2=0x55952e5b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b6f80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f095809b720 tx=0x7f09580982c0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 shutdown_connections 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55952e5bd5e0 0x55952e5b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55952e5b3190 0x55952e5b6f80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55952e645710 0x55952e644420 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 --2- 172.21.15.100:0/3681883647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55952e5b2870 0x55952e5b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09517fa640 0 client.15102 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 >> 172.21.15.100:0/3681883647 conn(0x55952e5aef60 msgr2=0x55952e5ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 shutdown_connections 2024-09-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 1 -- 172.21.15.100:0/3681883647 wait complete. 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f09725f5740 20 client.15102 trim_cache size 0 max 16384 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24433, 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 84.765723124000004, 2024-09-12T02:06:39.846 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 23, 2024-09-12T02:06:39.847 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:06:39.847 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:06:39.847 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 111.944194147 2024-09-12T02:06:39.847 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:39.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09540a2c10 msgr2=0x7f09540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09540a2c10 0x7f09540a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0960009430 tx=0x7f096002a950 comp rx=0 tx=0).stop 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102570 msgr2=0x7f0968197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102570 0x7f0968197840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f095800c920 tx=0x7f095800cde0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 shutdown_connections 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f09540a2c10 0x7f09540a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0968102ef0 0x7f096819bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0968102570 0x7f0968197840 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 --2- 172.21.15.100:0/396983516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0968100e20 0x7f0968197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 >> 172.21.15.100:0/396983516 conn(0x7f09680fc7d0 msgr2=0x7f09681067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.840+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 shutdown_connections 2024-09-12T02:06:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:39.841+0000 7f097021c640 1 -- 172.21.15.100:0/396983516 wait complete. 2024-09-12T02:06:40.425 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:06:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3361750000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 msgr2=0x7f48f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3361750000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f410ea90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009ca0 tx=0x7f48ec02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3361750000 shutdown_connections 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3361750000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f410ea90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3361750000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f4102790 0x7f48f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3361750000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48f4101de0 0x7f48f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3361750000 >> 172.21.15.100:0/3361750000 conn(0x7f48f40fd8c0 msgr2=0x7f48f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3361750000 shutdown_connections 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.125+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3361750000 wait complete. 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 Processor -- start 2024-09-12T02:06:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 -- start start 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48f4101de0 0x7f48f4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f4102790 0x7f48f4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4112010 con 0x7f48f4106f10 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4111e90 con 0x7f48f4102790 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48fa3b9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4112190 con 0x7f48f4101de0 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48f8956640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48f8956640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43968/0 (socket says 172.21.15.100:43968) 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.126+0000 7f48f8956640 1 -- 172.21.15.100:0/3483942160 learned_addr learned my addr 172.21.15.100:0/3483942160 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f37fe640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f4102790 0x7f48f4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f8956640 1 -- 172.21.15.100:0/3483942160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48f4101de0 msgr2=0x7f48f4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f3fff640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48f4101de0 0x7f48f4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f8956640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48f4101de0 0x7f48f4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f8956640 1 -- 172.21.15.100:0/3483942160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f4102790 msgr2=0x7f48f4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f8956640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f4102790 0x7f48f4198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f8956640 1 -- 172.21.15.100:0/3483942160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f419d520 con 0x7f48f4106f10 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f37fe640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f4102790 0x7f48f4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f3fff640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48f4101de0 0x7f48f4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f8956640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f419ce40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f48ec031a60 tx=0x7f48ec031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f17fa640 1 -- 172.21.15.100:0/3483942160 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec003c30 con 0x7f48f4106f10 2024-09-12T02:06:41.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f17fa640 1 -- 172.21.15.100:0/3483942160 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48ec003dd0 con 0x7f48f4106f10 2024-09-12T02:06:41.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48f17fa640 1 -- 172.21.15.100:0/3483942160 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0047e0 con 0x7f48f4106f10 2024-09-12T02:06:41.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f419d7b0 con 0x7f48f4106f10 2024-09-12T02:06:41.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.127+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f41a50f0 con 0x7f48f4106f10 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.129+0000 7f48f17fa640 1 -- 172.21.15.100:0/3483942160 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f48ec02f790 con 0x7f48f4106f10 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.129+0000 7f48fc792740 1 Processor -- start 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.129+0000 7f48fc792740 1 -- start start 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48fc792740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a6e9d0 0x561721a6edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48fc792740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6f2f0 0x561721a79670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48fc792740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a79bb0 0x561721a7bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48fc792740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5617219d5090 con 0x561721a6f2f0 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48fc792740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56172197ca70 con 0x561721a79bb0 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48fc792740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5617219d1050 con 0x561721a6e9d0 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6f2f0 0x561721a79670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6f2f0 0x561721a79670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43984/0 (socket says 172.21.15.100:43984) 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f3fff640 1 -- 172.21.15.100:0/441296263 learned_addr learned my addr 172.21.15.100:0/441296263 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:41.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f37fe640 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a6e9d0 0x561721a6edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f17fa640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f48dc0a2c10 0x7f48dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f37fe640 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a79bb0 0x561721a7bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f8956640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f48dc0a2c10 0x7f48dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f37fe640 1 -- 172.21.15.100:0/441296263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a79bb0 msgr2=0x561721a7bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f37fe640 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a79bb0 0x561721a7bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f37fe640 1 -- 172.21.15.100:0/441296263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6f2f0 msgr2=0x561721a79670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f17fa640 1 -- 172.21.15.100:0/3483942160 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f48ec0f0590 con 0x7f48f4106f10 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f37fe640 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6f2f0 0x561721a79670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f37fe640 1 -- 172.21.15.100:0/441296263 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561721989130 con 0x561721a6e9d0 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.130+0000 7f48f3fff640 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6f2f0 0x561721a79670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.131+0000 7f48f37fe640 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a6e9d0 0x561721a6edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48f40fdce0 tx=0x7f48e800c190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c29fce5a08cd0c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.131+0000 7f48f8956640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f48dc0a2c10 0x7f48dc0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0bcd40 tx=0x7f48ec0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.131+0000 7f48da7fc640 1 -- 172.21.15.100:0/441296263 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e801c070 con 0x561721a6e9d0 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.131+0000 7f48da7fc640 1 -- 172.21.15.100:0/441296263 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e8017af0 con 0x561721a6e9d0 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.131+0000 7f48da7fc640 1 -- 172.21.15.100:0/441296263 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e800f040 con 0x561721a6e9d0 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.131+0000 7f48fc792740 1 -- 172.21.15.100:0/441296263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a6e9d0 msgr2=0x561721a6edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.131+0000 7f48fc792740 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a6e9d0 0x561721a6edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48f40fdce0 tx=0x7f48e800c190 comp rx=0 tx=0).stop 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- 172.21.15.100:0/441296263 shutdown_connections 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a79bb0 0x561721a7bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6f2f0 0x561721a79670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 --2- 172.21.15.100:0/441296263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a6e9d0 0x561721a6edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- 172.21.15.100:0/441296263 >> 172.21.15.100:0/441296263 conn(0x561721a6af60 msgr2=0x561721a6b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- 172.21.15.100:0/441296263 shutdown_connections 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- 172.21.15.100:0/441296263 wait complete. 2024-09-12T02:06:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- start start 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 Processor -- start 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a79470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a767c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a76d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561721a7c780 con 0x561721a6e9d0 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56172198ff20 con 0x561721a6f2f0 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561721a7c900 con 0x561721a79bb0 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.132+0000 7f48fc792740 10 client.0 _ll_register_callbacks cb 0x561721959030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a79470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a79470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43998/0 (socket says 172.21.15.100:43998) 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 -- 172.21.15.100:0/1991394888 learned_addr learned my addr 172.21.15.100:0/1991394888 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a76d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f3fff640 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 -- 172.21.15.100:0/1991394888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 msgr2=0x561721a76d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a76d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 -- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 msgr2=0x561721a767c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a767c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 -- 172.21.15.100:0/1991394888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617217462b0 con 0x561721a6e9d0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48f37fe640 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a79470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f48e8015460 tx=0x7f48e80046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc246524424a5c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48d37fe640 1 -- 172.21.15.100:0/1991394888 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e801c070 con 0x561721a6e9d0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48d37fe640 1 -- 172.21.15.100:0/1991394888 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f48e80178c0 con 0x561721a6e9d0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e8017af0 con 0x561721a6e9d0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48d37fe640 1 -- 172.21.15.100:0/1991394888 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f48e8016750 con 0x561721a6e9d0 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48fc792740 10 client.15114 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561721a880d0 con 0x561721a6e9d0 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.133+0000 7f48d37fe640 1 -- 172.21.15.100:0/1991394888 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e8017af0 con 0x561721a6e9d0 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48d37fe640 1 -- 172.21.15.100:0/1991394888 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f48e802e080 con 0x561721a6e9d0 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48fc792740 10 client.15114 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48fc792740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48fc792740 20 client.15114 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48fc792740 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721a8a390 0x561721a8b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48fc792740 4 client.15114 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617219e2600 con 0x561721a8a390 2024-09-12T02:06:41.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.134+0000 7f48f3fff640 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721a8a390 0x561721a8b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48d37fe640 10 client.15114 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:41.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48f3fff640 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721a8a390 0x561721a8b800 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5494dc251fafef0d server_cookie=209abab71a4642a4 in_seq=0 out_seq=0 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48d37fe640 1 -- 172.21.15.100:0/1991394888 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617219e2600 con 0x561721a8a390 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48d37fe640 10 client.15114 handle_command_reply: tid=0 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48fc792740 1 client.15114 shutdown 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 msgr2=0x561721a79470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48fc792740 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a79470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f48e8015460 tx=0x7f48e80046a0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.135+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 shutdown_connections 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721a8a390 0x561721a8b800 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a76d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a767c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 1 --2- 172.21.15.100:0/1991394888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a79470 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 >> 172.21.15.100:0/1991394888 conn(0x561721a6af60 msgr2=0x561721a70c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48d37fe640 0 client.15114 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:41.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 shutdown_connections 2024-09-12T02:06:41.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 1 -- 172.21.15.100:0/1991394888 wait complete. 2024-09-12T02:06:41.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.136+0000 7f48fc792740 20 client.15114 trim_cache size 0 max 16384 2024-09-12T02:06:41.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 Processor -- start 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 -- start start 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a8aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561721a89b40 con 0x561721a6e9d0 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561721a8a210 con 0x561721a6f2f0 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48fc792740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561721a8a8e0 con 0x561721a79bb0 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44012/0 (socket says 172.21.15.100:44012) 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.153+0000 7f48f37fe640 1 -- 172.21.15.100:0/3121520951 learned_addr learned my addr 172.21.15.100:0/3121520951 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48f37fe640 1 -- 172.21.15.100:0/3121520951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 msgr2=0x561721a89cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48f37fe640 1 --2- 172.21.15.100:0/3121520951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48f37fe640 1 -- 172.21.15.100:0/3121520951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 msgr2=0x561721a8aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48f37fe640 1 --2- 172.21.15.100:0/3121520951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a8aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48f37fe640 1 -- 172.21.15.100:0/3121520951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561721a6f120 con 0x561721a6e9d0 2024-09-12T02:06:41.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48f37fe640 1 --2- 172.21.15.100:0/3121520951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8b130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f48e8021b60 tx=0x7f48e8021f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c11f8188f5c9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48d9ffb640 1 -- 172.21.15.100:0/3121520951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e800a030 con 0x561721a6e9d0 2024-09-12T02:06:41.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48d9ffb640 1 -- 172.21.15.100:0/3121520951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e802b070 con 0x561721a6e9d0 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.154+0000 7f48d9ffb640 1 -- 172.21.15.100:0/3121520951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e801c040 con 0x561721a6e9d0 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 -- 172.21.15.100:0/3121520951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 msgr2=0x561721a8b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 --2- 172.21.15.100:0/3121520951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8b130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f48e8021b60 tx=0x7f48e8021f40 comp rx=0 tx=0).stop 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 -- 172.21.15.100:0/3121520951 shutdown_connections 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 --2- 172.21.15.100:0/3121520951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a89cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 --2- 172.21.15.100:0/3121520951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a8aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 --2- 172.21.15.100:0/3121520951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8b130 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 -- 172.21.15.100:0/3121520951 >> 172.21.15.100:0/3121520951 conn(0x561721a6af60 msgr2=0x561721a6b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 -- 172.21.15.100:0/3121520951 shutdown_connections 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 -- 172.21.15.100:0/3121520951 wait complete. 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 -- start start 2024-09-12T02:06:41.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 Processor -- start 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.155+0000 7f48fc792740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a8ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48fc792740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a8f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48fc792740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561721a8b680 con 0x561721a6e9d0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48fc792740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561721a8afb0 con 0x561721a6f2f0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48fc792740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561721a8bd50 con 0x561721a79bb0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48fc792740 10 client.0 _ll_register_callbacks cb 0x7f48e801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44022/0 (socket says 172.21.15.100:44022) 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 -- 172.21.15.100:0/4072660306 learned_addr learned my addr 172.21.15.100:0/4072660306 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f3fff640 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a8ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 -- 172.21.15.100:0/4072660306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 msgr2=0x561721a8f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a8f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 -- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 msgr2=0x561721a8ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a8ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 -- 172.21.15.100:0/4072660306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561721af2c60 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48f37fe640 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8e9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f48e8019040 tx=0x7f48e8006a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ca2b29c08856bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48d37fe640 1 -- 172.21.15.100:0/4072660306 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e801c040 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48d37fe640 1 -- 172.21.15.100:0/4072660306 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f48e80213b0 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.156+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e802b070 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48d37fe640 1 -- 172.21.15.100:0/4072660306 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f48e800f040 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 10 client.15120 fetch_fsmap learned FSMap version 23 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561721af3f00 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48d37fe640 1 -- 172.21.15.100:0/4072660306 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e802b070 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48d37fe640 1 -- 172.21.15.100:0/4072660306 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f48e802e050 con 0x561721a6e9d0 2024-09-12T02:06:41.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 10 client.15120 fetch_fsmap finished waiting for FSMap version 23 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 20 client.15120 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721af87e0 0x561721af74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 4 client.15120 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "status"}) -- 0x5617219dcb10 con 0x561721af87e0 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.157+0000 7f48f3fff640 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721af87e0 0x561721af74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48d37fe640 10 client.15120 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48f3fff640 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721af87e0 0x561721af74f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17344c2bf818e22c server_cookie=aac6bb3b0f440c6b in_seq=0 out_seq=0 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48d37fe640 1 -- 172.21.15.100:0/4072660306 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5617219dcb10 con 0x561721af87e0 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48d37fe640 10 client.15120 handle_command_reply: tid=0 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 client.15120 shutdown 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 msgr2=0x561721a8e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8e9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f48e8019040 tx=0x7f48e8006a40 comp rx=0 tx=0).stop 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 shutdown_connections 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x561721af87e0 0x561721af74f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561721a79bb0 0x561721a8f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561721a6f2f0 0x561721a8ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 --2- 172.21.15.100:0/4072660306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561721a6e9d0 0x561721a8e9c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 >> 172.21.15.100:0/4072660306 conn(0x561721a6af60 msgr2=0x561721a69800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48d37fe640 0 client.15120 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 shutdown_connections 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 1 -- 172.21.15.100:0/4072660306 wait complete. 2024-09-12T02:06:41.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.158+0000 7f48fc792740 20 client.15120 trim_cache size 0 max 16384 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24452, 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 93.116575670000003, 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 23, 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 104.181077139 2024-09-12T02:06:41.164 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f48dc0a2c10 msgr2=0x7f48dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f48dc0a2c10 0x7f48dc0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0bcd40 tx=0x7f48ec0095c0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 msgr2=0x7f48f419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f419ce40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f48ec031a60 tx=0x7f48ec031a90 comp rx=0 tx=0).stop 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 shutdown_connections 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f48dc0a2c10 0x7f48dc0a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48f4106f10 0x7f48f419ce40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f4102790 0x7f48f4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 --2- 172.21.15.100:0/3483942160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48f4101de0 0x7f48f4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 >> 172.21.15.100:0/3483942160 conn(0x7f48f40fd8c0 msgr2=0x7f48f40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 shutdown_connections 2024-09-12T02:06:41.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:41.159+0000 7f48fa3b9640 1 -- 172.21.15.100:0/3483942160 wait complete. 2024-09-12T02:06:41.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:41 smithi100 ceph-mon[31179]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:41 smithi189 ceph-mon[35188]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:41 smithi117 ceph-mon[35240]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:06:41.926 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:06:41.936 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:06:41.936 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:06:41.936 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:06:41.936 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:06:42.073 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:06:42.073 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T02:06:42.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:42.073 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-12T02:06:42.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:42.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-12T02:06:42.157 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-09-12T02:06:42.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:06:42.159 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T02:06:42.159 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:06:42.159 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:42.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:06:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:42.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 -- 172.21.15.100:0/2976732669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc1062b0 msgr2=0x7f7ffc106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 --2- 172.21.15.100:0/2976732669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc1062b0 0x7f7ffc106690 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009930 tx=0x7f7fec02a420 comp rx=0 tx=0).stop 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 -- 172.21.15.100:0/2976732669 shutdown_connections 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 --2- 172.21.15.100:0/2976732669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ffc100c00 0x7f7ffc10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 --2- 172.21.15.100:0/2976732669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc1002a0 0x7f7ffc1006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 --2- 172.21.15.100:0/2976732669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc1062b0 0x7f7ffc106690 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 -- 172.21.15.100:0/2976732669 >> 172.21.15.100:0/2976732669 conn(0x7f7ffc0fc5c0 msgr2=0x7f7ffc0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 -- 172.21.15.100:0/2976732669 shutdown_connections 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.914+0000 7f8002d98640 1 -- 172.21.15.100:0/2976732669 wait complete. 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 Processor -- start 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 -- start start 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc1002a0 0x7f7ffc199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100c00 0x7f7ffc199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ffc1062b0 0x7f7ffc1a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1105d0 con 0x7f7ffc100c00 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc110450 con 0x7f7ffc1062b0 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f8002d98640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc110750 con 0x7f7ffc1002a0 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100c00 0x7f7ffc199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.915+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100c00 0x7f7ffc199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44040/0 (socket says 172.21.15.100:44040) 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ffbfff640 1 -- 172.21.15.100:0/2488909814 learned_addr learned my addr 172.21.15.100:0/2488909814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f8000b34640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc1002a0 0x7f7ffc199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f8001335640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ffc1062b0 0x7f7ffc1a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ffbfff640 1 -- 172.21.15.100:0/2488909814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc1002a0 msgr2=0x7f7ffc199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ffbfff640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc1002a0 0x7f7ffc199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ffbfff640 1 -- 172.21.15.100:0/2488909814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ffc1062b0 msgr2=0x7f7ffc1a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ffbfff640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ffc1062b0 0x7f7ffc1a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:42.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ffbfff640 1 -- 172.21.15.100:0/2488909814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc1a48e0 con 0x7f7ffc100c00 2024-09-12T02:06:42.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f8001335640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ffc1062b0 0x7f7ffc1a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:42.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ffbfff640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100c00 0x7f7ffc199860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400d770 tx=0x7f7fe400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:42.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ff9ffb640 1 -- 172.21.15.100:0/2488909814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4017070 con 0x7f7ffc100c00 2024-09-12T02:06:42.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc1a4ab0 con 0x7f7ffc100c00 2024-09-12T02:06:42.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ff9ffb640 1 -- 172.21.15.100:0/2488909814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fe4005500 con 0x7f7ffc100c00 2024-09-12T02:06:42.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f7ff9ffb640 1 -- 172.21.15.100:0/2488909814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4004e00 con 0x7f7ffc100c00 2024-09-12T02:06:42.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.916+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc1a4fa0 con 0x7f7ffc100c00 2024-09-12T02:06:42.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.917+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ffc1006c0 con 0x7f7ffc100c00 2024-09-12T02:06:42.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.918+0000 7f7ff9ffb640 1 -- 172.21.15.100:0/2488909814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7fe4004fa0 con 0x7f7ffc100c00 2024-09-12T02:06:42.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.919+0000 7f7ff9ffb640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7fe80a2c10 0x7f7fe80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:42.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.919+0000 7f8000b34640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7fe80a2c10 0x7f7fe80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:42.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.919+0000 7f7ff9ffb640 1 -- 172.21.15.100:0/2488909814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7fe40cec40 con 0x7f7ffc100c00 2024-09-12T02:06:42.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.919+0000 7f8000b34640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7fe80a2c10 0x7f7fe80a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009900 tx=0x7f7fec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:42.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:42.923+0000 7f7ff9ffb640 1 -- 172.21.15.100:0/2488909814 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7fe40d5080 con 0x7f7ffc100c00 2024-09-12T02:06:43.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.130+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7ffc1a5230 con 0x7f7ffc100c00 2024-09-12T02:06:43.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.130+0000 7f7ff9ffb640 1 -- 172.21.15.100:0/2488909814 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f7fe409ba50 con 0x7f7ffc100c00 2024-09-12T02:06:43.130 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:06:43.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7fe80a2c10 msgr2=0x7f7fe80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7fe80a2c10 0x7f7fe80a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009900 tx=0x7f7fec0058d0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100c00 msgr2=0x7f7ffc199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100c00 0x7f7ffc199860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400d770 tx=0x7f7fe400dc30 comp rx=0 tx=0).stop 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 shutdown_connections 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7fe80a2c10 0x7f7fe80a50d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ffc1062b0 0x7f7ffc1a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100c00 0x7f7ffc199860 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 --2- 172.21.15.100:0/2488909814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ffc1002a0 0x7f7ffc199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 >> 172.21.15.100:0/2488909814 conn(0x7f7ffc0fc5c0 msgr2=0x7f7ffc101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 shutdown_connections 2024-09-12T02:06:43.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43.132+0000 7f8002d98640 1 -- 172.21.15.100:0/2488909814 wait complete. 2024-09-12T02:06:43.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:43 smithi100 ceph-mon[31179]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:43.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:43 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2488909814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:06:43.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:43 smithi189 ceph-mon[35188]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:43.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:43 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2488909814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:06:43.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:43 smithi117 ceph-mon[35240]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:43.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:43 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2488909814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:06:43.701 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:43.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:43.702 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-12T02:06:43.717 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-12T02:06:43.718 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:06:43.719 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:43.719 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:06:43.719 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:06:43.719 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:06:43.719 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42233sec preferred_lft 42233sec 2024-09-12T02:06:43.719 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-12T02:06:43.719 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:06:43.720 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:06:43.720 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:06:43.720 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:06:43.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:06:43.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-12T02:06:43.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-12T02:06:43.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:06:43.720 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:06:43.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:43.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:43.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:43.930 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:06:43.954 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-12T02:06:43.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:43.955 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-12T02:06:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-12T02:06:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:06:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:06:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:06:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:06:44.018 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:06:44.019 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:06:44.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:06:44.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:06:44.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:06:44.019 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:06:44.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:44.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:44.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:44.330 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-12T02:06:44.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:44.346 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-12T02:06:44.401 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:06:44.402 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:06:44.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:06:44.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:06:44.402 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:06:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:44.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:44.519 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:06:44.519 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:06:44.519 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:06:44.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:06:44.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:06:44.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:06:44.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:06:44.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:06:44.520 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:06:44.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:44.645 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:06:44.645 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-12T02:06:44.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-12T02:06:44.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:06:44.646 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-12T02:06:44.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:44.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:44.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:06:44.725 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:06:44.741 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:44.796 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T02:06:44.796 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T02:06:44.796 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/80bbd05c-1c24-4a8b-97b9-49391beb9e7d 2024-09-12T02:06:44.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:44.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/80bbd05c-1c24-4a8b-97b9-49391beb9e7d /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T02:06:44.923 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T02:06:44.923 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T02:06:44.923 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-12T02:06:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T02:06:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T02:06:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-12T02:06:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.117:3300,172.21.15.189:3300" 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:3300,172.21.15.117:3300,172.21.15.189:3300:/volumes/qa/sv_1/80bbd05c-1c24-4a8b-97b9-49391beb9e7d 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=3a2902f2-70aa-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:06:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:06:45.073 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:06:45.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:06:45.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:45.102 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:06:45.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:45.210 INFO:teuthology.orchestra.run.smithi100.stdout:client24728 2024-09-12T02:06:45.211 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:06:45.211 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:06:45.228 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:06:45.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:06:45.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:45.337 INFO:teuthology.orchestra.run.smithi100.stdout:client24728 2024-09-12T02:06:45.337 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:06:45.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:06:45.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi100.stdout:client24728 2024-09-12T02:06:45.403 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968.client24728/status') 2024-09-12T02:06:45.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:06:45.466 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.24728 (3)172.21.15.100:0/1153356947 2024-09-12T02:06:45.466 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi100.stderr:72 bytes copied, 2.4769e-05 s, 2.9 MB/s 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:06:45.474 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:06:45.483 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:06:45.483 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:06:45.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-12T02:06:45.506 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:45 smithi100 ceph-mon[31179]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:45.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 -- 172.21.15.100:0/3350795244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc104ef0 msgr2=0x7f0cfc1072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/3350795244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc104ef0 0x7f0cfc1072e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009900 tx=0x7f0cec02a410 comp rx=0 tx=0).stop 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 -- 172.21.15.100:0/3350795244 shutdown_connections 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/3350795244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc107820 0x7f0cfc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/3350795244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc104ef0 0x7f0cfc1072e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/3350795244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cfc1025c0 0x7f0cfc1049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 -- 172.21.15.100:0/3350795244 >> 172.21.15.100:0/3350795244 conn(0x7f0cfc0fc1e0 msgr2=0x7f0cfc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 -- 172.21.15.100:0/3350795244 shutdown_connections 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.586+0000 7f0d03ab7640 1 -- 172.21.15.100:0/3350795244 wait complete. 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 Processor -- start 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 -- start start 2024-09-12T02:06:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc1025c0 0x7f0cfc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc104ef0 0x7f0cfc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cfc107820 0x7f0cfc19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc10d850 con 0x7f0cfc1025c0 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc10d6d0 con 0x7f0cfc104ef0 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d03ab7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc10d9d0 con 0x7f0cfc107820 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d01853640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc1025c0 0x7f0cfc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d01853640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc1025c0 0x7f0cfc197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37856/0 (socket says 172.21.15.100:37856) 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d01853640 1 -- 172.21.15.100:0/1423712344 learned_addr learned my addr 172.21.15.100:0/1423712344 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.587+0000 7f0d01052640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc104ef0 0x7f0cfc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d02054640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cfc107820 0x7f0cfc19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d01853640 1 -- 172.21.15.100:0/1423712344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cfc107820 msgr2=0x7f0cfc19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d01853640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cfc107820 0x7f0cfc19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d01853640 1 -- 172.21.15.100:0/1423712344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc104ef0 msgr2=0x7f0cfc198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d01853640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc104ef0 0x7f0cfc198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d01853640 1 -- 172.21.15.100:0/1423712344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc19faf0 con 0x7f0cfc1025c0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d02054640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cfc107820 0x7f0cfc19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d01853640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc1025c0 0x7f0cfc197ed0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800b4a0 tx=0x7f0cf800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0cf2ffd640 1 -- 172.21.15.100:0/1423712344 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8014070 con 0x7f0cfc1025c0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cfc19fde0 con 0x7f0cfc1025c0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0cf2ffd640 1 -- 172.21.15.100:0/1423712344 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cf8010af0 con 0x7f0cfc1025c0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0cf2ffd640 1 -- 172.21.15.100:0/1423712344 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8017d10 con 0x7f0cfc1025c0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.588+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cfc1a02d0 con 0x7f0cfc1025c0 2024-09-12T02:06:45.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:45 smithi189 ceph-mon[35188]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.589+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cfc0fdcd0 con 0x7f0cfc1025c0 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.591+0000 7f0cf2ffd640 1 -- 172.21.15.100:0/1423712344 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0cf8017070 con 0x7f0cfc1025c0 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.592+0000 7f0cf2ffd640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0ce80a2cd0 0x7f0ce80a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.592+0000 7f0cf2ffd640 1 -- 172.21.15.100:0/1423712344 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0cf80ce870 con 0x7f0cfc1025c0 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.592+0000 7f0d01052640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0ce80a2cd0 0x7f0ce80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.592+0000 7f0d01052640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0ce80a2cd0 0x7f0ce80a5190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0cec005ab0 tx=0x7f0cec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.594+0000 7f0cf2ffd640 1 -- 172.21.15.100:0/1423712344 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cf809b730 con 0x7f0cfc1025c0 2024-09-12T02:06:45.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:45 smithi117 ceph-mon[35240]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:06:45.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:45.805+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f0cfc02d7c0 con 0x7f0cfc1025c0 2024-09-12T02:06:46.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.228+0000 7f0cf2ffd640 1 -- 172.21.15.100:0/1423712344 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f0cf809b030 con 0x7f0cfc1025c0 2024-09-12T02:06:46.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0ce80a2cd0 msgr2=0x7f0ce80a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0ce80a2cd0 0x7f0ce80a5190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0cec005ab0 tx=0x7f0cec000bc0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc1025c0 msgr2=0x7f0cfc197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc1025c0 0x7f0cfc197ed0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800b4a0 tx=0x7f0cf800b960 comp rx=0 tx=0).stop 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 shutdown_connections 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0ce80a2cd0 0x7f0ce80a5190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cfc107820 0x7f0cfc19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc104ef0 0x7f0cfc198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 --2- 172.21.15.100:0/1423712344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cfc1025c0 0x7f0cfc197ed0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 >> 172.21.15.100:0/1423712344 conn(0x7f0cfc0fc1e0 msgr2=0x7f0cfc103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 shutdown_connections 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.231+0000 7f0d03ab7640 1 -- 172.21.15.100:0/1423712344 wait complete. 2024-09-12T02:06:46.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-12T02:06:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.386+0000 7f5e37533640 1 -- 172.21.15.100:0/1471094901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e30100a40 msgr2=0x7f5e30100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.386+0000 7f5e37533640 1 --2- 172.21.15.100:0/1471094901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e30100a40 0x7f5e30100e40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009900 tx=0x7f5e2c02a410 comp rx=0 tx=0).stop 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- 172.21.15.100:0/1471094901 shutdown_connections 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 --2- 172.21.15.100:0/1471094901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e301025f0 0x7f5e30108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 --2- 172.21.15.100:0/1471094901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e30101c30 0x7f5e301020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 --2- 172.21.15.100:0/1471094901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e30100a40 0x7f5e30100e40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- 172.21.15.100:0/1471094901 >> 172.21.15.100:0/1471094901 conn(0x7f5e300fc1e0 msgr2=0x7f5e300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- 172.21.15.100:0/1471094901 shutdown_connections 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- 172.21.15.100:0/1471094901 wait complete. 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 Processor -- start 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- start start 2024-09-12T02:06:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e30100a40 0x7f5e3006a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e30101c30 0x7f5e3019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e301025f0 0x7f5e3019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3010c7f0 con 0x7f5e301025f0 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3010c670 con 0x7f5e30101c30 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e37533640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3010c970 con 0x7f5e30100a40 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.387+0000 7f5e35ad0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e301025f0 0x7f5e3019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e301025f0 0x7f5e3019f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37878/0 (socket says 172.21.15.100:37878) 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 -- 172.21.15.100:0/2300171887 learned_addr learned my addr 172.21.15.100:0/2300171887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e352cf640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e30100a40 0x7f5e3006a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 -- 172.21.15.100:0/2300171887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e30100a40 msgr2=0x7f5e3006a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e30100a40 0x7f5e3006a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 -- 172.21.15.100:0/2300171887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e30101c30 msgr2=0x7f5e3019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e30101c30 0x7f5e3019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 -- 172.21.15.100:0/2300171887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3019fbd0 con 0x7f5e301025f0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e35ad0640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e301025f0 0x7f5e3019f2c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800b970 tx=0x7f5e2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e267fc640 1 -- 172.21.15.100:0/2300171887 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28019070 con 0x7f5e301025f0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e267fc640 1 -- 172.21.15.100:0/2300171887 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e2800cb40 con 0x7f5e301025f0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3019fe60 con 0x7f5e301025f0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e267fc640 1 -- 172.21.15.100:0/2300171887 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28007650 con 0x7f5e301025f0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.388+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e301a0450 con 0x7f5e301025f0 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.389+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e30107e30 con 0x7f5e301025f0 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.390+0000 7f5e267fc640 1 -- 172.21.15.100:0/2300171887 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5e2801c070 con 0x7f5e301025f0 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.391+0000 7f5e267fc640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e1c0a2d50 0x7f5e1c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.391+0000 7f5e352cf640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e1c0a2d50 0x7f5e1c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.391+0000 7f5e267fc640 1 -- 172.21.15.100:0/2300171887 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5e280ce6d0 con 0x7f5e301025f0 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.391+0000 7f5e352cf640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e1c0a2d50 0x7f5e1c0a5210 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c031610 tx=0x7f5e2c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.395+0000 7f5e267fc640 1 -- 172.21.15.100:0/2300171887 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e2809b590 con 0x7f5e301025f0 2024-09-12T02:06:46.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:46 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1423712344' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.587+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f5e30062790 con 0x7f5e1c0a2d50 2024-09-12T02:06:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.592+0000 7f5e267fc640 1 -- 172.21.15.100:0/2300171887 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f5e30062790 con 0x7f5e1c0a2d50 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi100.stdout:{} 2024-09-12T02:06:46.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:46 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1423712344' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e1c0a2d50 msgr2=0x7f5e1c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e1c0a2d50 0x7f5e1c0a5210 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c031610 tx=0x7f5e2c005fd0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e301025f0 msgr2=0x7f5e3019f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e301025f0 0x7f5e3019f2c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800b970 tx=0x7f5e2800be30 comp rx=0 tx=0).stop 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 shutdown_connections 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f5e1c0a2d50 0x7f5e1c0a5210 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e301025f0 0x7f5e3019f2c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e30101c30 0x7f5e3019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 --2- 172.21.15.100:0/2300171887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e30100a40 0x7f5e3006a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 >> 172.21.15.100:0/2300171887 conn(0x7f5e300fc1e0 msgr2=0x7f5e30105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 shutdown_connections 2024-09-12T02:06:46.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.594+0000 7f5e37533640 1 -- 172.21.15.100:0/2300171887 wait complete. 2024-09-12T02:06:46.605 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T02:06:46.615 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T02:06:46.639 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:06:46.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:46 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1423712344' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.736+0000 7f06dc731640 1 -- 172.21.15.100:0/3803179523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4101c00 msgr2=0x7f06d4102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.736+0000 7f06dc731640 1 --2- 172.21.15.100:0/3803179523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4101c00 0x7f06d4102080 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009900 tx=0x7f06c802a410 comp rx=0 tx=0).stop 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- 172.21.15.100:0/3803179523 shutdown_connections 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 --2- 172.21.15.100:0/3803179523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06d41025c0 0x7f06d4108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 --2- 172.21.15.100:0/3803179523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4101c00 0x7f06d4102080 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 --2- 172.21.15.100:0/3803179523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d4100a10 0x7f06d4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- 172.21.15.100:0/3803179523 >> 172.21.15.100:0/3803179523 conn(0x7f06d40fc170 msgr2=0x7f06d40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- 172.21.15.100:0/3803179523 shutdown_connections 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- 172.21.15.100:0/3803179523 wait complete. 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 Processor -- start 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- start start 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4100a10 0x7f06d4197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d4101c00 0x7f06d41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06d41025c0 0x7f06d419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06d410d7e0 con 0x7f06d4100a10 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06d410d660 con 0x7f06d4101c00 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06dc731640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f06d410d960 con 0x7f06d41025c0 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06da4cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4100a10 0x7f06d4197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06da4cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4100a10 0x7f06d4197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37892/0 (socket says 172.21.15.100:37892) 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.737+0000 7f06da4cd640 1 -- 172.21.15.100:0/1663663996 learned_addr learned my addr 172.21.15.100:0/1663663996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06dacce640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06d41025c0 0x7f06d419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06d9ccc640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d4101c00 0x7f06d41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06da4cd640 1 -- 172.21.15.100:0/1663663996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06d41025c0 msgr2=0x7f06d419f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06da4cd640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06d41025c0 0x7f06d419f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06da4cd640 1 -- 172.21.15.100:0/1663663996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d4101c00 msgr2=0x7f06d41983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06da4cd640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d4101c00 0x7f06d41983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06da4cd640 1 -- 172.21.15.100:0/1663663996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d419faa0 con 0x7f06d4100a10 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06d9ccc640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d4101c00 0x7f06d41983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06da4cd640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4100a10 0x7f06d4197e80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06c400ccb0 tx=0x7f06c400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06d37fe640 1 -- 172.21.15.100:0/1663663996 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4003990 con 0x7f06d4100a10 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06d37fe640 1 -- 172.21.15.100:0/1663663996 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06c4003b30 con 0x7f06d4100a10 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d419fd90 con 0x7f06d4100a10 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06d37fe640 1 -- 172.21.15.100:0/1663663996 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c400f7b0 con 0x7f06d4100a10 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.738+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d41a0250 con 0x7f06d4100a10 2024-09-12T02:06:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.739+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d4107da0 con 0x7f06d4100a10 2024-09-12T02:06:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.741+0000 7f06d37fe640 1 -- 172.21.15.100:0/1663663996 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f06c4004a40 con 0x7f06d4100a10 2024-09-12T02:06:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.741+0000 7f06d37fe640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f06bc0a2ca0 0x7f06bc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.742+0000 7f06d9ccc640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f06bc0a2ca0 0x7f06bc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.742+0000 7f06d37fe640 1 -- 172.21.15.100:0/1663663996 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f06c40cf6d0 con 0x7f06d4100a10 2024-09-12T02:06:46.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.742+0000 7f06d9ccc640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f06bc0a2ca0 0x7f06bc0a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06c8000c00 tx=0x7f06c8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.745+0000 7f06d37fe640 1 -- 172.21.15.100:0/1663663996 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06c4014030 con 0x7f06d4100a10 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.913+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06d402da70 con 0x7f06d4100a10 2024-09-12T02:06:46.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.915+0000 7f06d37fe640 1 -- 172.21.15.100:0/1663663996 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7f06c409c560 con 0x7f06d4100a10 2024-09-12T02:06:46.917 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:46.917 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f06bc0a2ca0 msgr2=0x7f06bc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f06bc0a2ca0 0x7f06bc0a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06c8000c00 tx=0x7f06c8031400 comp rx=0 tx=0).stop 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4100a10 msgr2=0x7f06d4197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4100a10 0x7f06d4197e80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06c400ccb0 tx=0x7f06c400a620 comp rx=0 tx=0).stop 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 shutdown_connections 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f06bc0a2ca0 0x7f06bc0a5160 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06d41025c0 0x7f06d419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d4101c00 0x7f06d41983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 --2- 172.21.15.100:0/1663663996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d4100a10 0x7f06d4197e80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 >> 172.21.15.100:0/1663663996 conn(0x7f06d40fc170 msgr2=0x7f06d4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 shutdown_connections 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:46.917+0000 7f06dc731640 1 -- 172.21.15.100:0/1663663996 wait complete. 2024-09-12T02:06:46.929 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:00:34.232777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:05:03.311397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:05:05.761455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:06:46.930 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.031+0000 7f25d8f6d640 1 -- 172.21.15.100:0/4016957973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4101bf0 msgr2=0x7f25d4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.031+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/4016957973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4101bf0 0x7f25d4102070 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009900 tx=0x7f25bc02a410 comp rx=0 tx=0).stop 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.031+0000 7f25d8f6d640 1 -- 172.21.15.100:0/4016957973 shutdown_connections 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.031+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/4016957973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d41025b0 0x7f25d4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.031+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/4016957973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4101bf0 0x7f25d4102070 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.031+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/4016957973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d4100a00 0x7f25d4100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.031+0000 7f25d8f6d640 1 -- 172.21.15.100:0/4016957973 >> 172.21.15.100:0/4016957973 conn(0x7f25d40fc140 msgr2=0x7f25d40fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:47.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 -- 172.21.15.100:0/4016957973 shutdown_connections 2024-09-12T02:06:47.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 -- 172.21.15.100:0/4016957973 wait complete. 2024-09-12T02:06:47.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 Processor -- start 2024-09-12T02:06:47.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 -- start start 2024-09-12T02:06:47.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4100a00 0x7f25d4069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d4101bf0 0x7f25d419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d41025b0 0x7f25d419f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25d410c680 con 0x7f25d4100a00 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25d410c500 con 0x7f25d41025b0 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d8f6d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25d410c800 con 0x7f25d4101bf0 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.032+0000 7f25d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4100a00 0x7f25d4069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4100a00 0x7f25d4069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37916/0 (socket says 172.21.15.100:37916) 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 -- 172.21.15.100:0/2931978150 learned_addr learned my addr 172.21.15.100:0/2931978150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:47.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d2d9d640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d41025b0 0x7f25d419f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d1d9b640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d4101bf0 0x7f25d419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 -- 172.21.15.100:0/2931978150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d4101bf0 msgr2=0x7f25d419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d4101bf0 0x7f25d419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 -- 172.21.15.100:0/2931978150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d41025b0 msgr2=0x7f25d419f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d41025b0 0x7f25d419f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 -- 172.21.15.100:0/2931978150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d419fb00 con 0x7f25d4100a00 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d1d9b640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d4101bf0 0x7f25d419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d259c640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4100a00 0x7f25d4069ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25c400eaa0 tx=0x7f25c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25cb7fe640 1 -- 172.21.15.100:0/2931978150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c4016070 con 0x7f25d4100a00 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25cb7fe640 1 -- 172.21.15.100:0/2931978150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c4003e50 con 0x7f25d4100a00 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d419fd90 con 0x7f25d4100a00 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25cb7fe640 1 -- 172.21.15.100:0/2931978150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c40116d0 con 0x7f25d4100a00 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.033+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d41a01a0 con 0x7f25d4100a00 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.034+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d4107ee0 con 0x7f25d4100a00 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.035+0000 7f25cb7fe640 1 -- 172.21.15.100:0/2931978150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f25c4019070 con 0x7f25d4100a00 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.036+0000 7f25cb7fe640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25c00a2c20 0x7f25c00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.036+0000 7f25d1d9b640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25c00a2c20 0x7f25c00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.036+0000 7f25cb7fe640 1 -- 172.21.15.100:0/2931978150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f25c40cf2c0 con 0x7f25d4100a00 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.037+0000 7f25d1d9b640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25c00a2c20 0x7f25c00a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:47.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.041+0000 7f25cb7fe640 1 -- 172.21.15.100:0/2931978150 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25c409c0d0 con 0x7f25d4100a00 2024-09-12T02:06:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.207+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f25d402da30 con 0x7f25d4100a00 2024-09-12T02:06:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.207+0000 7f25cb7fe640 1 -- 172.21.15.100:0/2931978150 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f25c409b9d0 con 0x7f25d4100a00 2024-09-12T02:06:47.208 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-12T02:06:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.209+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25c00a2c20 msgr2=0x7f25c00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.209+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25c00a2c20 0x7f25c00a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc0095f0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.209+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4100a00 msgr2=0x7f25d4069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.209+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4100a00 0x7f25d4069ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25c400eaa0 tx=0x7f25c400ef60 comp rx=0 tx=0).stop 2024-09-12T02:06:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 shutdown_connections 2024-09-12T02:06:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25c00a2c20 0x7f25c00a50e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d41025b0 0x7f25d419f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d4101bf0 0x7f25d419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 --2- 172.21.15.100:0/2931978150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4100a00 0x7f25d4069ef0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 >> 172.21.15.100:0/2931978150 conn(0x7f25d40fc140 msgr2=0x7f25d41050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 shutdown_connections 2024-09-12T02:06:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.210+0000 7f25d8f6d640 1 -- 172.21.15.100:0/2931978150 wait complete. 2024-09-12T02:06:47.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:06:47.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 -- 172.21.15.100:0/1798395969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 msgr2=0x7f7790108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 --2- 172.21.15.100:0/1798395969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f7790108e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7788009ca0 tx=0x7f778802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 -- 172.21.15.100:0/1798395969 shutdown_connections 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 --2- 172.21.15.100:0/1798395969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f7790108e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 --2- 172.21.15.100:0/1798395969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7790101bf0 0x7f7790102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 --2- 172.21.15.100:0/1798395969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7790100a00 0x7f7790100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 -- 172.21.15.100:0/1798395969 >> 172.21.15.100:0/1798395969 conn(0x7f77900fc140 msgr2=0x7f77900fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 -- 172.21.15.100:0/1798395969 shutdown_connections 2024-09-12T02:06:47.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.323+0000 7f7795042640 1 -- 172.21.15.100:0/1798395969 wait complete. 2024-09-12T02:06:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 Processor -- start 2024-09-12T02:06:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 -- start start 2024-09-12T02:06:47.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7790100a00 0x7f7790197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7790101bf0 0x7f7790198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f779019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f779010c660 con 0x7f77901025b0 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f779010c4e0 con 0x7f7790100a00 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.324+0000 7f7795042640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f779010c7e0 con 0x7f7790101bf0 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f779019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f779019f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37940/0 (socket says 172.21.15.100:37940) 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 -- 172.21.15.100:0/2698128866 learned_addr learned my addr 172.21.15.100:0/2698128866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778e59c640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7790101bf0 0x7f7790198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778ed9d640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7790100a00 0x7f7790197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 -- 172.21.15.100:0/2698128866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7790101bf0 msgr2=0x7f7790198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7790101bf0 0x7f7790198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 -- 172.21.15.100:0/2698128866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7790100a00 msgr2=0x7f7790197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7790100a00 0x7f7790197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 -- 172.21.15.100:0/2698128866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779019fa40 con 0x7f77901025b0 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f778f59e640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f779019f3d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7788005e30 tx=0x7f7788031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f7777fff640 1 -- 172.21.15.100:0/2698128866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788003c30 con 0x7f77901025b0 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779019fcd0 con 0x7f77901025b0 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f7777fff640 1 -- 172.21.15.100:0/2698128866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7788003dd0 con 0x7f77901025b0 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f7777fff640 1 -- 172.21.15.100:0/2698128866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778802fde0 con 0x7f77901025b0 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.325+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77901a0210 con 0x7f77901025b0 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.326+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77901a0440 con 0x7f77901025b0 2024-09-12T02:06:47.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.328+0000 7f7777fff640 1 -- 172.21.15.100:0/2698128866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7788004050 con 0x7f77901025b0 2024-09-12T02:06:47.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.328+0000 7f7777fff640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77780a2c20 0x7f77780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.328+0000 7f778ed9d640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77780a2c20 0x7f77780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.328+0000 7f7777fff640 1 -- 172.21.15.100:0/2698128866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f77880f05b0 con 0x7f77901025b0 2024-09-12T02:06:47.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.329+0000 7f778ed9d640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77780a2c20 0x7f77780a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7790101a50 tx=0x7f778000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.332+0000 7f7777fff640 1 -- 172.21.15.100:0/2698128866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77880bd4d0 con 0x7f77901025b0 2024-09-12T02:06:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.497+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f77901a07d0 con 0x7f77901025b0 2024-09-12T02:06:47.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.498+0000 7f7777fff640 1 -- 172.21.15.100:0/2698128866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f77880bcdd0 con 0x7f77901025b0 2024-09-12T02:06:47.499 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-12T02:06:47.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77780a2c20 msgr2=0x7f77780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77780a2c20 0x7f77780a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7790101a50 tx=0x7f778000b390 comp rx=0 tx=0).stop 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 msgr2=0x7f779019f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f779019f3d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7788005e30 tx=0x7f7788031ee0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 shutdown_connections 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f77780a2c20 0x7f77780a50e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77901025b0 0x7f779019f3d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7790101bf0 0x7f7790198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 --2- 172.21.15.100:0/2698128866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7790100a00 0x7f7790197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 >> 172.21.15.100:0/2698128866 conn(0x7f77900fc140 msgr2=0x7f7790069330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 shutdown_connections 2024-09-12T02:06:47.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.500+0000 7f7795042640 1 -- 172.21.15.100:0/2698128866 wait complete. 2024-09-12T02:06:47.511 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:47 smithi100 ceph-mon[31179]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:47.511 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:47 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1423712344' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:06:47.511 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:47 smithi100 ceph-mon[31179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:06:47.511 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:47 smithi100 ceph-mon[31179]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:47.511 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:47 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1663663996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:47.511 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:47 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2931978150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:06:47.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:06:47.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:47 smithi189 ceph-mon[35188]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:47.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:47 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1423712344' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:06:47.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:47 smithi189 ceph-mon[35188]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:06:47.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:47 smithi189 ceph-mon[35188]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:47.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:47 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1663663996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:47.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:47 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2931978150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:06:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/1653920290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c1025b0 msgr2=0x7fc99c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/1653920290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c1025b0 0x7fc99c108e40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc994009ca0 tx=0x7fc99402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/1653920290 shutdown_connections 2024-09-12T02:06:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/1653920290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c1025b0 0x7fc99c108e40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/1653920290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc99c101bf0 0x7fc99c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/1653920290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99c100a00 0x7fc99c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/1653920290 >> 172.21.15.100:0/1653920290 conn(0x7fc99c0fc140 msgr2=0x7fc99c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/1653920290 shutdown_connections 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.613+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/1653920290 wait complete. 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 Processor -- start 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 -- start start 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c100a00 0x7fc99c197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99c101bf0 0x7fc99c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc99c1025b0 0x7fc99c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10d7d0 con 0x7fc99c100a00 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10d650 con 0x7fc99c101bf0 2024-09-12T02:06:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc9a0cc3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10d950 con 0x7fc99c1025b0 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc99a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c100a00 0x7fc99c197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc99a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c100a00 0x7fc99c197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37956/0 (socket says 172.21.15.100:37956) 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.614+0000 7fc99a59c640 1 -- 172.21.15.100:0/2885223367 learned_addr learned my addr 172.21.15.100:0/2885223367 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc991d9b640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99c101bf0 0x7fc99c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc99ad9d640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc99c1025b0 0x7fc99c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc99a59c640 1 -- 172.21.15.100:0/2885223367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc99c1025b0 msgr2=0x7fc99c19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc99a59c640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc99c1025b0 0x7fc99c19f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc99a59c640 1 -- 172.21.15.100:0/2885223367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99c101bf0 msgr2=0x7fc99c1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc99a59c640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99c101bf0 0x7fc99c1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc99a59c640 1 -- 172.21.15.100:0/2885223367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c19f980 con 0x7fc99c100a00 2024-09-12T02:06:47.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc99a59c640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c100a00 0x7fc99c197d60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00c970 tx=0x7fc98c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:47.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc993fff640 1 -- 172.21.15.100:0/2885223367 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c007c10 con 0x7fc99c100a00 2024-09-12T02:06:47.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c19fc70 con 0x7fc99c100a00 2024-09-12T02:06:47.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc993fff640 1 -- 172.21.15.100:0/2885223367 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc98c007db0 con 0x7fc99c100a00 2024-09-12T02:06:47.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc993fff640 1 -- 172.21.15.100:0/2885223367 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00f8a0 con 0x7fc99c100a00 2024-09-12T02:06:47.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.615+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c1a01c0 con 0x7fc99c100a00 2024-09-12T02:06:47.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.616+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c107da0 con 0x7fc99c100a00 2024-09-12T02:06:47.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.617+0000 7fc993fff640 1 -- 172.21.15.100:0/2885223367 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc98c00fa60 con 0x7fc99c100a00 2024-09-12T02:06:47.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.618+0000 7fc993fff640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9880a2c20 0x7fc9880a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:47.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.618+0000 7fc991d9b640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9880a2c20 0x7fc9880a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:47.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.618+0000 7fc993fff640 1 -- 172.21.15.100:0/2885223367 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc98c0cf5c0 con 0x7fc99c100a00 2024-09-12T02:06:47.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.618+0000 7fc991d9b640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9880a2c20 0x7fc9880a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc984005fd0 tx=0x7fc984005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:47.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.622+0000 7fc993fff640 1 -- 172.21.15.100:0/2885223367 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc98c09c460 con 0x7fc99c100a00 2024-09-12T02:06:47.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:47 smithi117 ceph-mon[35240]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:06:47.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:47 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1423712344' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:06:47.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:47 smithi117 ceph-mon[35240]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:06:47.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:47 smithi117 ceph-mon[35240]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:47.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:47 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1663663996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:47.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:47 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2931978150' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:06:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.789+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc99c02d990 con 0x7fc99c100a00 2024-09-12T02:06:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.789+0000 7fc993fff640 1 -- 172.21.15.100:0/2885223367 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7fc98c09bd60 con 0x7fc99c100a00 2024-09-12T02:06:47.791 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-09-12T02:06:47.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9880a2c20 msgr2=0x7fc9880a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9880a2c20 0x7fc9880a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc984005fd0 tx=0x7fc984005850 comp rx=0 tx=0).stop 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c100a00 msgr2=0x7fc99c197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c100a00 0x7fc99c197d60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00c970 tx=0x7fc98c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 shutdown_connections 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fc9880a2c20 0x7fc9880a50e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc99c1025b0 0x7fc99c19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc99c101bf0 0x7fc99c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 --2- 172.21.15.100:0/2885223367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c100a00 0x7fc99c197d60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 >> 172.21.15.100:0/2885223367 conn(0x7fc99c0fc140 msgr2=0x7fc99c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 shutdown_connections 2024-09-12T02:06:47.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:47.791+0000 7fc9a0cc3640 1 -- 172.21.15.100:0/2885223367 wait complete. 2024-09-12T02:06:47.803 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T02:06:47.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:06:48.062 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:48.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:48 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2698128866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:06:48.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:48 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2885223367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:06:48.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:48 smithi100 ceph-mon[31179]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 -- 172.21.15.100:0/1177354079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848103660 msgr2=0x7fe84810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 --2- 172.21.15.100:0/1177354079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848103660 0x7fe84810bb50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009900 tx=0x7fe83c02a480 comp rx=0 tx=0).stop 2024-09-12T02:06:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 -- 172.21.15.100:0/1177354079 shutdown_connections 2024-09-12T02:06:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 --2- 172.21.15.100:0/1177354079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe84810c170 0x7fe84810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 --2- 172.21.15.100:0/1177354079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848103660 0x7fe84810bb50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 --2- 172.21.15.100:0/1177354079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe848102d40 0x7fe848103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 -- 172.21.15.100:0/1177354079 >> 172.21.15.100:0/1177354079 conn(0x7fe8480fc7a0 msgr2=0x7fe8480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 -- 172.21.15.100:0/1177354079 shutdown_connections 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 -- 172.21.15.100:0/1177354079 wait complete. 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 Processor -- start 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.518+0000 7fe84d607640 1 -- start start 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe84d607640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848102d40 0x7fe848198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe84d607640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe848103660 0x7fe848198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe84d607640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe84810c170 0x7fe84819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe84d607640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe848111f70 con 0x7fe848102d40 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe84d607640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe848111df0 con 0x7fe84810c170 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe84d607640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8481120f0 con 0x7fe848103660 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848102d40 0x7fe848198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848102d40 0x7fe848198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37982/0 (socket says 172.21.15.100:37982) 2024-09-12T02:06:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 -- 172.21.15.100:0/1860476270 learned_addr learned my addr 172.21.15.100:0/1860476270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe8477fe640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe84810c170 0x7fe84819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe8467fc640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe848103660 0x7fe848198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 -- 172.21.15.100:0/1860476270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe848103660 msgr2=0x7fe848198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe848103660 0x7fe848198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 -- 172.21.15.100:0/1860476270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe84810c170 msgr2=0x7fe84819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe84810c170 0x7fe84819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 -- 172.21.15.100:0/1860476270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84819d400 con 0x7fe848102d40 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe8477fe640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe84810c170 0x7fe84819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe846ffd640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848102d40 0x7fe848198450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe83800d770 tx=0x7fe83800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe82ffff640 1 -- 172.21.15.100:0/1860476270 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838017070 con 0x7fe848102d40 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe82ffff640 1 -- 172.21.15.100:0/1860476270 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe838005500 con 0x7fe848102d40 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe82ffff640 1 -- 172.21.15.100:0/1860476270 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838004e00 con 0x7fe848102d40 2024-09-12T02:06:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.519+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84819d6f0 con 0x7fe848102d40 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.520+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8481a4fd0 con 0x7fe848102d40 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.521+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe848103120 con 0x7fe848102d40 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.522+0000 7fe82ffff640 1 -- 172.21.15.100:0/1860476270 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe838004fa0 con 0x7fe848102d40 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.522+0000 7fe82ffff640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8300a2c10 0x7fe8300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.522+0000 7fe8467fc640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8300a2c10 0x7fe8300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.523+0000 7fe82ffff640 1 -- 172.21.15.100:0/1860476270 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe8380cecf0 con 0x7fe848102d40 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.523+0000 7fe8467fc640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8300a2c10 0x7fe8300a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8480feda0 tx=0x7fe83c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:48.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.527+0000 7fe82ffff640 1 -- 172.21.15.100:0/1860476270 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe83809bb00 con 0x7fe848102d40 2024-09-12T02:06:48.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:48 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2698128866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:06:48.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:48 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2885223367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:06:48.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:48 smithi189 ceph-mon[35188]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:48 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2698128866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:06:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:48 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2885223367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:06:48.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:48 smithi117 ceph-mon[35240]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:06:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.724+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8481071e0 con 0x7fe848102d40 2024-09-12T02:06:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.725+0000 7fe82ffff640 1 -- 172.21.15.100:0/1860476270 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7fe83809b400 con 0x7fe848102d40 2024-09-12T02:06:48.726 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:48.727 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:06:48.727 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.727+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8300a2c10 msgr2=0x7fe8300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.727+0000 7fe84d607640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8300a2c10 0x7fe8300a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8480feda0 tx=0x7fe83c005a20 comp rx=0 tx=0).stop 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.727+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848102d40 msgr2=0x7fe848198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.727+0000 7fe84d607640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848102d40 0x7fe848198450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe83800d770 tx=0x7fe83800dc30 comp rx=0 tx=0).stop 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 shutdown_connections 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe8300a2c10 0x7fe8300a50d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe84810c170 0x7fe84819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe848103660 0x7fe848198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 --2- 172.21.15.100:0/1860476270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe848102d40 0x7fe848198450 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 >> 172.21.15.100:0/1860476270 conn(0x7fe8480fc7a0 msgr2=0x7fe8480fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:48.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 shutdown_connections 2024-09-12T02:06:48.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:48.728+0000 7fe84d607640 1 -- 172.21.15.100:0/1860476270 wait complete. 2024-09-12T02:06:49.464 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:49 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1860476270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:49.465 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T02:06:49.465 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T02:06:49.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 -- 172.21.15.100:0/1454986975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c107810 msgr2=0x7f2b5c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1454986975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c107810 0x7f2b5c109c80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009ca0 tx=0x7f2b5402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 -- 172.21.15.100:0/1454986975 shutdown_connections 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1454986975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c107810 0x7f2b5c109c80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1454986975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c104ee0 0x7f2b5c1072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1454986975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b5c1025b0 0x7f2b5c1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 -- 172.21.15.100:0/1454986975 >> 172.21.15.100:0/1454986975 conn(0x7f2b5c0fc1b0 msgr2=0x7f2b5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 -- 172.21.15.100:0/1454986975 shutdown_connections 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.569+0000 7f2b60e65640 1 -- 172.21.15.100:0/1454986975 wait complete. 2024-09-12T02:06:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 Processor -- start 2024-09-12T02:06:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 -- start start 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c1025b0 0x7f2b5c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c104ee0 0x7f2b5c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b5c107810 0x7f2b5c19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c10d850 con 0x7f2b5c1025b0 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c10d6d0 con 0x7f2b5c104ee0 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b60e65640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c10d9d0 con 0x7f2b5c107810 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b5a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c1025b0 0x7f2b5c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b5a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c1025b0 0x7f2b5c197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37998/0 (socket says 172.21.15.100:37998) 2024-09-12T02:06:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.570+0000 7f2b5a59c640 1 -- 172.21.15.100:0/1600335965 learned_addr learned my addr 172.21.15.100:0/1600335965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b5ad9d640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b5c107810 0x7f2b5c19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b5a59c640 1 -- 172.21.15.100:0/1600335965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b5c107810 msgr2=0x7f2b5c19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b5a59c640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b5c107810 0x7f2b5c19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b5a59c640 1 -- 172.21.15.100:0/1600335965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c104ee0 msgr2=0x7f2b5c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b59d9b640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c104ee0 0x7f2b5c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b5a59c640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c104ee0 0x7f2b5c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b5a59c640 1 -- 172.21.15.100:0/1600335965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c19fb80 con 0x7f2b5c1025b0 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b59d9b640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c104ee0 0x7f2b5c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b5a59c640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c1025b0 0x7f2b5c197f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00b4a0 tx=0x7f2b4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b537fe640 1 -- 172.21.15.100:0/1600335965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c014070 con 0x7f2b5c1025b0 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b537fe640 1 -- 172.21.15.100:0/1600335965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b4c010af0 con 0x7f2b5c1025b0 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c19fe70 con 0x7f2b5c1025b0 2024-09-12T02:06:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b537fe640 1 -- 172.21.15.100:0/1600335965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c017d10 con 0x7f2b5c1025b0 2024-09-12T02:06:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.571+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c1a0280 con 0x7f2b5c1025b0 2024-09-12T02:06:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.572+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c0fdca0 con 0x7f2b5c1025b0 2024-09-12T02:06:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.573+0000 7f2b537fe640 1 -- 172.21.15.100:0/1600335965 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2b4c017070 con 0x7f2b5c1025b0 2024-09-12T02:06:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.574+0000 7f2b537fe640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2b480a2c20 0x7f2b480a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.574+0000 7f2b537fe640 1 -- 172.21.15.100:0/1600335965 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2b4c0ce5a0 con 0x7f2b5c1025b0 2024-09-12T02:06:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.574+0000 7f2b59d9b640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2b480a2c20 0x7f2b480a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.574+0000 7f2b59d9b640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2b480a2c20 0x7f2b480a50e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005d00 tx=0x7f2b44005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.578+0000 7f2b537fe640 1 -- 172.21.15.100:0/1600335965 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b4c09b4c0 con 0x7f2b5c1025b0 2024-09-12T02:06:49.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:49 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1860476270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:49.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:49 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1860476270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.740+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b5c062630 con 0x7f2b480a2c20 2024-09-12T02:06:49.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.746+0000 7f2b537fe640 1 -- 172.21.15.100:0/1600335965 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258716 (secure 0 0 0) 0x7f2b5c062630 con 0x7f2b480a2c20 2024-09-12T02:06:49.750 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2b480a2c20 msgr2=0x7f2b480a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2b480a2c20 0x7f2b480a50e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005d00 tx=0x7f2b44005ed0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c1025b0 msgr2=0x7f2b5c197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c1025b0 0x7f2b5c197f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00b4a0 tx=0x7f2b4c00b960 comp rx=0 tx=0).stop 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 shutdown_connections 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f2b480a2c20 0x7f2b480a50e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b5c107810 0x7f2b5c19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c104ee0 0x7f2b5c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 --2- 172.21.15.100:0/1600335965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b5c1025b0 0x7f2b5c197f60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 >> 172.21.15.100:0/1600335965 conn(0x7f2b5c0fc1b0 msgr2=0x7f2b5c102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 shutdown_connections 2024-09-12T02:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.749+0000 7f2b60e65640 1 -- 172.21.15.100:0/1600335965 wait complete. 2024-09-12T02:06:49.761 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-12T02:06:48.039935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":681,"num_read_kb":452,"num_write":345,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353548,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588276,"statfs":{"total":1151940427776,"available":1151578394624,"internally_reserved":0,"allocated":12890112,"data_stored":7212539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002945"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:42.889936+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:42.889936+0000","last_peered":"2024-09-12T02:06:42.889936+0000","last_clean":"2024-09-12T02:06:42.889936+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:42.889936+0000","last_undegraded":"2024-09-12T02:06:42.889936+0000","last_fullsized":"2024-09-12T02:06:42.889936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":112,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:41.887740+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:41.887740+0000","last_peered":"2024-09-12T02:06:41.887740+0000","last_clean":"2024-09-12T02:06:41.887740+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:41.887740+0000","last_undegraded":"2024-09-12T02:06:41.887740+0000","last_fullsized":"2024-09-12T02:06:41.887740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":233,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:42.889201+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:42.889201+0000","last_peered":"2024-09-12T02:06:42.889201+0000","last_clean":"2024-09-12T02:06:42.889201+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:42.889201+0000","last_undegraded":"2024-09-12T02:06:42.889201+0000","last_fullsized":"2024-09-12T02:06:42.889201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":149,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":117,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.891902+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:44.891902+0000","last_peered":"2024-09-12T02:06:44.891902+0000","last_clean":"2024-09-12T02:06:44.891902+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:44.891902+0000","last_undegraded":"2024-09-12T02:06:44.891902+0000","last_fullsized":"2024-09-12T02:06:44.891902+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275237+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275237+0000","last_peered":"2024-09-12T02:05:23.275237+0000","last_clean":"2024-09-12T02:05:23.275237+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275237+0000","last_undegraded":"2024-09-12T02:05:23.275237+0000","last_fullsized":"2024-09-12T02:05:23.275237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":115,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:43.889553+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:43.889553+0000","last_peered":"2024-09-12T02:06:43.889553+0000","last_clean":"2024-09-12T02:06:43.889553+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:43.889553+0000","last_undegraded":"2024-09-12T02:06:43.889553+0000","last_fullsized":"2024-09-12T02:06:43.889553+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.127440+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:23.127440+0000","last_peered":"2024-09-12T02:05:23.127440+0000","last_clean":"2024-09-12T02:05:23.127440+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:23.127440+0000","last_undegraded":"2024-09-12T02:05:23.127440+0000","last_fullsized":"2024-09-12T02:05:23.127440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":555,"num_read_kb":343,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579936,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1589248,"data_stored":1089254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1029781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":498352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:49.766 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:06:49.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 -- 172.21.15.100:0/1539604855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 msgr2=0x7fb3cc101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/1539604855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc101f30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc009900 tx=0x7fb3bc02a410 comp rx=0 tx=0).stop 2024-09-12T02:06:49.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 -- 172.21.15.100:0/1539604855 shutdown_connections 2024-09-12T02:06:49.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/1539604855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3cc1036e0 0x7fb3cc109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/1539604855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3cc102d20 0x7fb3cc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/1539604855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc101f30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 -- 172.21.15.100:0/1539604855 >> 172.21.15.100:0/1539604855 conn(0x7fb3cc0fd2b0 msgr2=0x7fb3cc0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 -- 172.21.15.100:0/1539604855 shutdown_connections 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.899+0000 7fb3d23cf640 1 -- 172.21.15.100:0/1539604855 wait complete. 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 Processor -- start 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 -- start start 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3cc102d20 0x7fb3cc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3cc1036e0 0x7fb3cc19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc10d790 con 0x7fb3cc101b30 2024-09-12T02:06:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc10d610 con 0x7fb3cc1036e0 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3d23cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc10d910 con 0x7fb3cc102d20 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38014/0 (socket says 172.21.15.100:38014) 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 -- 172.21.15.100:0/2059993441 learned_addr learned my addr 172.21.15.100:0/2059993441 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cb7fe640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3cc102d20 0x7fb3cc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 -- 172.21.15.100:0/2059993441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3cc102d20 msgr2=0x7fb3cc1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3cc102d20 0x7fb3cc1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 -- 172.21.15.100:0/2059993441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3cc1036e0 msgr2=0x7fb3cc19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3cc1036e0 0x7fb3cc19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.900+0000 7fb3cbfff640 1 -- 172.21.15.100:0/2059993441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3cc19fa90 con 0x7fb3cc101b30 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.901+0000 7fb3cbfff640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc197e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc031610 tx=0x7fb3bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.901+0000 7fb3c97fa640 1 -- 172.21.15.100:0/2059993441 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc03f030 con 0x7fb3cc101b30 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.901+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3cc19fd20 con 0x7fb3cc101b30 2024-09-12T02:06:49.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.901+0000 7fb3c97fa640 1 -- 172.21.15.100:0/2059993441 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3bc003ad0 con 0x7fb3cc101b30 2024-09-12T02:06:49.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.901+0000 7fb3c97fa640 1 -- 172.21.15.100:0/2059993441 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc035070 con 0x7fb3cc101b30 2024-09-12T02:06:49.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.901+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3cc1a01c0 con 0x7fb3cc101b30 2024-09-12T02:06:49.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.902+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3cc108f70 con 0x7fb3cc101b30 2024-09-12T02:06:49.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.903+0000 7fb3c97fa640 1 -- 172.21.15.100:0/2059993441 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb3bc042030 con 0x7fb3cc101b30 2024-09-12T02:06:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.904+0000 7fb3c97fa640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3b40a2c20 0x7fb3b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.904+0000 7fb3cb7fe640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3b40a2c20 0x7fb3b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.904+0000 7fb3c97fa640 1 -- 172.21.15.100:0/2059993441 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb3bc0efc10 con 0x7fb3cc101b30 2024-09-12T02:06:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.904+0000 7fb3cb7fe640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3b40a2c20 0x7fb3b40a50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc199380 tx=0x7fb3c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:49.907+0000 7fb3c97fa640 1 -- 172.21.15.100:0/2059993441 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3bc0bca20 con 0x7fb3cc101b30 2024-09-12T02:06:50.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.071+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3cc062630 con 0x7fb3b40a2c20 2024-09-12T02:06:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.078+0000 7fb3c97fa640 1 -- 172.21.15.100:0/2059993441 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258720 (secure 0 0 0) 0x7fb3cc062630 con 0x7fb3b40a2c20 2024-09-12T02:06:50.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3b40a2c20 msgr2=0x7fb3b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3b40a2c20 0x7fb3b40a50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc199380 tx=0x7fb3c0005f90 comp rx=0 tx=0).stop 2024-09-12T02:06:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 msgr2=0x7fb3cc197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc197e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc031610 tx=0x7fb3bc004270 comp rx=0 tx=0).stop 2024-09-12T02:06:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 shutdown_connections 2024-09-12T02:06:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb3b40a2c20 0x7fb3b40a50e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3cc1036e0 0x7fb3cc19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3cc102d20 0x7fb3cc1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 --2- 172.21.15.100:0/2059993441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3cc101b30 0x7fb3cc197e70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 >> 172.21.15.100:0/2059993441 conn(0x7fb3cc0fd2b0 msgr2=0x7fb3cc106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 shutdown_connections 2024-09-12T02:06:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.081+0000 7fb3d23cf640 1 -- 172.21.15.100:0/2059993441 wait complete. 2024-09-12T02:06:50.093 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-12T02:06:50.040449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661819,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":709,"num_read_kb":476,"num_write":352,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353564,"kb_used_data":12604,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588260,"statfs":{"total":1151940427776,"available":1151578378240,"internally_reserved":0,"allocated":12906496,"data_stored":7227747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7450,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":54,"num_write":7,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":126,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.897541+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:47.897541+0000","last_peered":"2024-09-12T02:06:47.897541+0000","last_clean":"2024-09-12T02:06:47.897541+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:47.897541+0000","last_undegraded":"2024-09-12T02:06:47.897541+0000","last_fullsized":"2024-09-12T02:06:47.897541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.895563+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:46.895563+0000","last_peered":"2024-09-12T02:06:46.895563+0000","last_clean":"2024-09-12T02:06:46.895563+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:46.895563+0000","last_undegraded":"2024-09-12T02:06:46.895563+0000","last_fullsized":"2024-09-12T02:06:46.895563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":248,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.897259+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:47.897259+0000","last_peered":"2024-09-12T02:06:47.897259+0000","last_clean":"2024-09-12T02:06:47.897259+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:47.897259+0000","last_undegraded":"2024-09-12T02:06:47.897259+0000","last_fullsized":"2024-09-12T02:06:47.897259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66906,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":162,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":117,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.891902+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:44.891902+0000","last_peered":"2024-09-12T02:06:44.891902+0000","last_clean":"2024-09-12T02:06:44.891902+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:44.891902+0000","last_undegraded":"2024-09-12T02:06:44.891902+0000","last_fullsized":"2024-09-12T02:06:44.891902+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275237+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275237+0000","last_peered":"2024-09-12T02:05:23.275237+0000","last_clean":"2024-09-12T02:05:23.275237+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275237+0000","last_undegraded":"2024-09-12T02:05:23.275237+0000","last_fullsized":"2024-09-12T02:05:23.275237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:48.897492+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:48.897492+0000","last_peered":"2024-09-12T02:06:48.897492+0000","last_clean":"2024-09-12T02:06:48.897492+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:48.897492+0000","last_undegraded":"2024-09-12T02:06:48.897492+0000","last_fullsized":"2024-09-12T02:06:48.897492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.116599+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:24.116599+0000","last_peered":"2024-09-12T02:05:24.116599+0000","last_clean":"2024-09-12T02:05:24.116599+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:24.116599+0000","last_undegraded":"2024-09-12T02:05:24.116599+0000","last_fullsized":"2024-09-12T02:05:24.116599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71217,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":583,"num_read_kb":367,"num_write":169,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":206817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716568,"statfs":{"total":95995035648,"available":95965765632,"internally_reserved":0,"allocated":1597440,"data_stored":1096396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1030089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":505802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:50.097 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T02:06:50.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 -- 172.21.15.100:0/3636635096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac102dc0 msgr2=0x7f59ac103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 --2- 172.21.15.100:0/3636635096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac102dc0 0x7f59ac103240 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5994009900 tx=0x7f599402a410 comp rx=0 tx=0).stop 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 -- 172.21.15.100:0/3636635096 shutdown_connections 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 --2- 172.21.15.100:0/3636635096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59ac103780 0x7f59ac10a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 --2- 172.21.15.100:0/3636635096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac102dc0 0x7f59ac103240 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 --2- 172.21.15.100:0/3636635096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ac0ffdf0 0x7f59ac1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 -- 172.21.15.100:0/3636635096 >> 172.21.15.100:0/3636635096 conn(0x7f59ac0fb950 msgr2=0x7f59ac0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 -- 172.21.15.100:0/3636635096 shutdown_connections 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.230+0000 7f59b0f03640 1 -- 172.21.15.100:0/3636635096 wait complete. 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 Processor -- start 2024-09-12T02:06:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 -- start start 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac0ffdf0 0x7f59ac197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59ac102dc0 0x7f59ac1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ac103780 0x7f59ac19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac10d820 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac10d6a0 con 0x7f59ac103780 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59b0f03640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac10d9a0 con 0x7f59ac102dc0 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac0ffdf0 0x7f59ac197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac0ffdf0 0x7f59ac197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38032/0 (socket says 172.21.15.100:38032) 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 -- 172.21.15.100:0/4000316156 learned_addr learned my addr 172.21.15.100:0/4000316156 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59a9d9b640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59ac102dc0 0x7f59ac1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 -- 172.21.15.100:0/4000316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59ac102dc0 msgr2=0x7f59ac1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59ac102dc0 0x7f59ac1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 -- 172.21.15.100:0/4000316156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ac103780 msgr2=0x7f59ac19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ac103780 0x7f59ac19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59aa59c640 1 -- 172.21.15.100:0/4000316156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac19faa0 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.231+0000 7f59a9d9b640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59ac102dc0 0x7f59ac1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.232+0000 7f59aa59c640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac0ffdf0 0x7f59ac197e80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59a400ccb0 tx=0x7f59a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.232+0000 7f59a37fe640 1 -- 172.21.15.100:0/4000316156 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4003990 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.232+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ac19fd90 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.232+0000 7f59a37fe640 1 -- 172.21.15.100:0/4000316156 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59a4003b30 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.232+0000 7f59a37fe640 1 -- 172.21.15.100:0/4000316156 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a400f7b0 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.232+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ac1a02a0 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.233+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ac108fe0 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.234+0000 7f59a37fe640 1 -- 172.21.15.100:0/4000316156 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f59a400f950 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.235+0000 7f59a37fe640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f59980a2c20 0x7f59980a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.235+0000 7f59a9d9b640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f59980a2c20 0x7f59980a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.235+0000 7f59a37fe640 1 -- 172.21.15.100:0/4000316156 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f59a40cf3a0 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.235+0000 7f59a9d9b640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f59980a2c20 0x7f59980a50e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5994000c00 tx=0x7f5994031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:50.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.239+0000 7f59a37fe640 1 -- 172.21.15.100:0/4000316156 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59a4014030 con 0x7f59ac0ffdf0 2024-09-12T02:06:50.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.405+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59ac062630 con 0x7f59980a2c20 2024-09-12T02:06:50.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.411+0000 7f59a37fe640 1 -- 172.21.15.100:0/4000316156 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258720 (secure 0 0 0) 0x7f59ac062630 con 0x7f59980a2c20 2024-09-12T02:06:50.415 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:50.416 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:50.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f59980a2c20 msgr2=0x7f59980a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f59980a2c20 0x7f59980a50e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5994000c00 tx=0x7f5994031400 comp rx=0 tx=0).stop 2024-09-12T02:06:50.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac0ffdf0 msgr2=0x7f59ac197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac0ffdf0 0x7f59ac197e80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59a400ccb0 tx=0x7f59a400a620 comp rx=0 tx=0).stop 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 shutdown_connections 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f59980a2c20 0x7f59980a50e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ac103780 0x7f59ac19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59ac102dc0 0x7f59ac1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 --2- 172.21.15.100:0/4000316156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59ac0ffdf0 0x7f59ac197e80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 >> 172.21.15.100:0/4000316156 conn(0x7f59ac0fb950 msgr2=0x7f59ac1061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 shutdown_connections 2024-09-12T02:06:50.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:50.414+0000 7f59b0f03640 1 -- 172.21.15.100:0/4000316156 wait complete. 2024-09-12T02:06:50.426 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:50 smithi100 ceph-mon[31179]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:50.426 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:50 smithi100 ceph-mon[31179]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:06:50.426 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:50 smithi100 ceph-mon[31179]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:50.427 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-12T02:06:50.040449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661819,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":709,"num_read_kb":476,"num_write":352,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353564,"kb_used_data":12604,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588260,"statfs":{"total":1151940427776,"available":1151578378240,"internally_reserved":0,"allocated":12906496,"data_stored":7227747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7450,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":54,"num_write":7,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":126,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.897541+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:47.897541+0000","last_peered":"2024-09-12T02:06:47.897541+0000","last_clean":"2024-09-12T02:06:47.897541+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:47.897541+0000","last_undegraded":"2024-09-12T02:06:47.897541+0000","last_fullsized":"2024-09-12T02:06:47.897541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.895563+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:46.895563+0000","last_peered":"2024-09-12T02:06:46.895563+0000","last_clean":"2024-09-12T02:06:46.895563+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:46.895563+0000","last_undegraded":"2024-09-12T02:06:46.895563+0000","last_fullsized":"2024-09-12T02:06:46.895563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":248,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.897259+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:47.897259+0000","last_peered":"2024-09-12T02:06:47.897259+0000","last_clean":"2024-09-12T02:06:47.897259+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:47.897259+0000","last_undegraded":"2024-09-12T02:06:47.897259+0000","last_fullsized":"2024-09-12T02:06:47.897259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66906,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":162,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":117,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.891902+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:44.891902+0000","last_peered":"2024-09-12T02:06:44.891902+0000","last_clean":"2024-09-12T02:06:44.891902+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:44.891902+0000","last_undegraded":"2024-09-12T02:06:44.891902+0000","last_fullsized":"2024-09-12T02:06:44.891902+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275237+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275237+0000","last_peered":"2024-09-12T02:05:23.275237+0000","last_clean":"2024-09-12T02:05:23.275237+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275237+0000","last_undegraded":"2024-09-12T02:05:23.275237+0000","last_fullsized":"2024-09-12T02:05:23.275237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:48.897492+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:48.897492+0000","last_peered":"2024-09-12T02:06:48.897492+0000","last_clean":"2024-09-12T02:06:48.897492+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:48.897492+0000","last_undegraded":"2024-09-12T02:06:48.897492+0000","last_fullsized":"2024-09-12T02:06:48.897492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.116599+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:24.116599+0000","last_peered":"2024-09-12T02:05:24.116599+0000","last_clean":"2024-09-12T02:05:24.116599+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:24.116599+0000","last_undegraded":"2024-09-12T02:05:24.116599+0000","last_fullsized":"2024-09-12T02:05:24.116599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71217,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":583,"num_read_kb":367,"num_write":169,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":206817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716568,"statfs":{"total":95995035648,"available":95965765632,"internally_reserved":0,"allocated":1597440,"data_stored":1096396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1030089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":505802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:50.431 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:06:50.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:50 smithi189 ceph-mon[35188]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:50.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:50 smithi189 ceph-mon[35188]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:06:50.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:50 smithi189 ceph-mon[35188]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:50.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:50 smithi117 ceph-mon[35240]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:50.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:50 smithi117 ceph-mon[35240]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:06:50.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:50 smithi117 ceph-mon[35240]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:51.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.154+0000 7fcd73838640 1 -- 172.21.15.100:0/1836014468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 msgr2=0x7fcd6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.154+0000 7fcd73838640 1 --2- 172.21.15.100:0/1836014468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c1021c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009900 tx=0x7fcd6802a410 comp rx=0 tx=0).stop 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.154+0000 7fcd73838640 1 -- 172.21.15.100:0/1836014468 shutdown_connections 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.154+0000 7fcd73838640 1 --2- 172.21.15.100:0/1836014468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd6c106f10 0x7fcd6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.154+0000 7fcd73838640 1 --2- 172.21.15.100:0/1836014468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6c102790 0x7fcd6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.154+0000 7fcd73838640 1 --2- 172.21.15.100:0/1836014468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c1021c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.154+0000 7fcd73838640 1 -- 172.21.15.100:0/1836014468 >> 172.21.15.100:0/1836014468 conn(0x7fcd6c0fd8c0 msgr2=0x7fcd6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.155+0000 7fcd73838640 1 -- 172.21.15.100:0/1836014468 shutdown_connections 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.155+0000 7fcd73838640 1 -- 172.21.15.100:0/1836014468 wait complete. 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.155+0000 7fcd73838640 1 Processor -- start 2024-09-12T02:06:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.155+0000 7fcd73838640 1 -- start start 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.155+0000 7fcd73838640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.155+0000 7fcd73838640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6c102790 0x7fcd6c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd73838640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd73838640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c111f70 con 0x7fcd6c101de0 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd73838640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c111df0 con 0x7fcd6c102790 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd73838640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1120f0 con 0x7fcd6c106f10 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38046/0 (socket says 172.21.15.100:38046) 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 -- 172.21.15.100:0/722035509 learned_addr learned my addr 172.21.15.100:0/722035509 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd70dd3640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6c102790 0x7fcd6c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd71dd5640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 -- 172.21.15.100:0/722035509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd6c106f10 msgr2=0x7fcd6c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 -- 172.21.15.100:0/722035509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6c102790 msgr2=0x7fcd6c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6c102790 0x7fcd6c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 -- 172.21.15.100:0/722035509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c19f640 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd715d4640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c19a690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006010 tx=0x7fcd680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd627fc640 1 -- 172.21.15.100:0/722035509 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6803f030 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd627fc640 1 -- 172.21.15.100:0/722035509 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd68003ce0 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c19f8d0 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd627fc640 1 -- 172.21.15.100:0/722035509 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68035070 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.156+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c1a7210 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.157+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6c1021c0 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.159+0000 7fcd627fc640 1 -- 172.21.15.100:0/722035509 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcd68042030 con 0x7fcd6c101de0 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.160+0000 7fcd627fc640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd580a2c90 0x7fcd580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:51.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.160+0000 7fcd70dd3640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd580a2c90 0x7fcd580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:51.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.160+0000 7fcd627fc640 1 -- 172.21.15.100:0/722035509 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcd680ef9e0 con 0x7fcd6c101de0 2024-09-12T02:06:51.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.160+0000 7fcd70dd3640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd580a2c90 0x7fcd580a5150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0ff820 tx=0x7fcd5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:51.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.163+0000 7fcd627fc640 1 -- 172.21.15.100:0/722035509 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd680bc260 con 0x7fcd6c101de0 2024-09-12T02:06:51.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.366+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd6c1a73e0 con 0x7fcd6c101de0 2024-09-12T02:06:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.367+0000 7fcd627fc640 1 -- 172.21.15.100:0/722035509 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7fcd680c0560 con 0x7fcd6c101de0 2024-09-12T02:06:51.368 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:51.368 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:06:51.368 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd580a2c90 msgr2=0x7fcd580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd580a2c90 0x7fcd580a5150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0ff820 tx=0x7fcd5c00b390 comp rx=0 tx=0).stop 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 msgr2=0x7fcd6c19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c19a690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006010 tx=0x7fcd680042f0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 shutdown_connections 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fcd580a2c90 0x7fcd580a5150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6c102790 0x7fcd6c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 --2- 172.21.15.100:0/722035509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd6c101de0 0x7fcd6c19a690 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 >> 172.21.15.100:0/722035509 conn(0x7fcd6c0fd8c0 msgr2=0x7fcd6c109200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 shutdown_connections 2024-09-12T02:06:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:51.370+0000 7fcd73838640 1 -- 172.21.15.100:0/722035509 wait complete. 2024-09-12T02:06:51.407 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:51 smithi100 ceph-mon[31179]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:51.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:51 smithi189 ceph-mon[35188]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:51.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:51 smithi117 ceph-mon[35240]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:52.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:06:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:52.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:52 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/722035509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:52.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:52 smithi100 ceph-mon[31179]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:52.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:52 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/722035509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:52.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:52 smithi189 ceph-mon[35188]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:52 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/722035509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:06:52.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:52 smithi117 ceph-mon[35240]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 -- 172.21.15.100:0/473569639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 msgr2=0x7f6efc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 --2- 172.21.15.100:0/473569639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc10d950 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009cd0 tx=0x7f6ef402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 -- 172.21.15.100:0/473569639 shutdown_connections 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 --2- 172.21.15.100:0/473569639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc10d950 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 --2- 172.21.15.100:0/473569639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6efc100a80 0x7f6efc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 --2- 172.21.15.100:0/473569639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6efc106a80 0x7f6efc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 -- 172.21.15.100:0/473569639 >> 172.21.15.100:0/473569639 conn(0x7f6efc0fc7a0 msgr2=0x7f6efc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 -- 172.21.15.100:0/473569639 shutdown_connections 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.720+0000 7f6f01b38640 1 -- 172.21.15.100:0/473569639 wait complete. 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 Processor -- start 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 -- start start 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6efc100a80 0x7f6efc1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6efc106a80 0x7f6efc1a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc110f20 con 0x7f6efc101420 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc110da0 con 0x7f6efc106a80 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6f01b38640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1110a0 con 0x7f6efc100a80 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6ef3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6ef3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc1998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38064/0 (socket says 172.21.15.100:38064) 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6ef3fff640 1 -- 172.21.15.100:0/696430550 learned_addr learned my addr 172.21.15.100:0/696430550 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6efbfff640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6efc106a80 0x7f6efc1a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.721+0000 7f6efb7fe640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6efc100a80 0x7f6efc1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef3fff640 1 -- 172.21.15.100:0/696430550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6efc100a80 msgr2=0x7f6efc1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef3fff640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6efc100a80 0x7f6efc1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef3fff640 1 -- 172.21.15.100:0/696430550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6efc106a80 msgr2=0x7f6efc1a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef3fff640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6efc106a80 0x7f6efc1a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef3fff640 1 -- 172.21.15.100:0/696430550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc1a4970 con 0x7f6efc101420 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef3fff640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc1998f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400b4a0 tx=0x7f6ee400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef97fa640 1 -- 172.21.15.100:0/696430550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4015020 con 0x7f6efc101420 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef97fa640 1 -- 172.21.15.100:0/696430550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee4011d10 con 0x7f6efc101420 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6ef97fa640 1 -- 172.21.15.100:0/696430550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400f2e0 con 0x7f6efc101420 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc1a4b40 con 0x7f6efc101420 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.722+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc1a5000 con 0x7f6efc101420 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.723+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc100f60 con 0x7f6efc101420 2024-09-12T02:06:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.724+0000 7f6ef97fa640 1 -- 172.21.15.100:0/696430550 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6ee4018020 con 0x7f6efc101420 2024-09-12T02:06:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.725+0000 7f6ef97fa640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6ee80a2c90 0x7f6ee80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.725+0000 7f6efb7fe640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6ee80a2c90 0x7f6ee80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.725+0000 7f6ef97fa640 1 -- 172.21.15.100:0/696430550 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6ee40cec40 con 0x7f6efc101420 2024-09-12T02:06:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.726+0000 7f6efb7fe640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6ee80a2c90 0x7f6ee80a5150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009990 tx=0x7f6eec009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.728+0000 7f6ef97fa640 1 -- 172.21.15.100:0/696430550 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ee401f020 con 0x7f6efc101420 2024-09-12T02:06:52.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.897+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6efc06ad80 con 0x7f6efc101420 2024-09-12T02:06:52.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.898+0000 7f6ef97fa640 1 -- 172.21.15.100:0/696430550 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7f6efc06ad80 con 0x7f6efc101420 2024-09-12T02:06:52.899 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.900+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6ee80a2c90 msgr2=0x7f6ee80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.900+0000 7f6f01b38640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6ee80a2c90 0x7f6ee80a5150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009990 tx=0x7f6eec009110 comp rx=0 tx=0).stop 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.900+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 msgr2=0x7f6efc1998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.900+0000 7f6f01b38640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc1998f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400b4a0 tx=0x7f6ee400b8a0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 shutdown_connections 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6ee80a2c90 0x7f6ee80a5150 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6efc106a80 0x7f6efc1a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6efc101420 0x7f6efc1998f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 --2- 172.21.15.100:0/696430550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6efc100a80 0x7f6efc1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 >> 172.21.15.100:0/696430550 conn(0x7f6efc0fc7a0 msgr2=0x7f6efc0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:52.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 shutdown_connections 2024-09-12T02:06:52.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:52.901+0000 7f6f01b38640 1 -- 172.21.15.100:0/696430550 wait complete. 2024-09-12T02:06:53.424 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:53 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/696430550' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:53.473 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T02:06:53.473 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-12T02:06:53.483 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:06:53.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-12T02:06:53.483 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T02:06:53.484 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:06:53.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:06:53.486 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T02:06:53.498 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:06:53.498 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:06:53.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:53 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/696430550' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:53.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:53 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/696430550' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:06:53.744 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:53.755 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:54.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:54 smithi100 ceph-mon[31179]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:06:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 -- 172.21.15.100:0/807805686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4101420 msgr2=0x7f45f410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 --2- 172.21.15.100:0/807805686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4101420 0x7f45f410d950 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009cd0 tx=0x7f45ec02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 -- 172.21.15.100:0/807805686 shutdown_connections 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 --2- 172.21.15.100:0/807805686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4101420 0x7f45f410d950 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 --2- 172.21.15.100:0/807805686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100a80 0x7f45f4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 --2- 172.21.15.100:0/807805686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f4106a80 0x7f45f4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 -- 172.21.15.100:0/807805686 >> 172.21.15.100:0/807805686 conn(0x7f45f40fc7a0 msgr2=0x7f45f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 -- 172.21.15.100:0/807805686 shutdown_connections 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.450+0000 7f45f880c640 1 -- 172.21.15.100:0/807805686 wait complete. 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 Processor -- start 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 -- start start 2024-09-12T02:06:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4100a80 0x7f45f41991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4101420 0x7f45f41996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f4106a80 0x7f45f41a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4110e80 con 0x7f45f4100a80 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4110d00 con 0x7f45f4106a80 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f880c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4111000 con 0x7f45f4101420 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4100a80 0x7f45f41991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4100a80 0x7f45f41991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36414/0 (socket says 172.21.15.100:36414) 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45f259c640 1 -- 172.21.15.100:0/2962798270 learned_addr learned my addr 172.21.15.100:0/2962798270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.451+0000 7f45ebfff640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4101420 0x7f45f41996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f4106a80 0x7f45f41a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f259c640 1 -- 172.21.15.100:0/2962798270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4101420 msgr2=0x7f45f41996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f259c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4101420 0x7f45f41996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f259c640 1 -- 172.21.15.100:0/2962798270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f4106a80 msgr2=0x7f45f41a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f259c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f4106a80 0x7f45f41a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f259c640 1 -- 172.21.15.100:0/2962798270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f41a4770 con 0x7f45f4100a80 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f4106a80 0x7f45f41a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f259c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4100a80 0x7f45f41991b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c920 tx=0x7f45e400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45eb7fe640 1 -- 172.21.15.100:0/2962798270 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4007bb0 con 0x7f45f4100a80 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45eb7fe640 1 -- 172.21.15.100:0/2962798270 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45e4007d50 con 0x7f45f4100a80 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f41a4940 con 0x7f45f4100a80 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45eb7fe640 1 -- 172.21.15.100:0/2962798270 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e40187d0 con 0x7f45f4100a80 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.452+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f41a4e20 con 0x7f45f4100a80 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.454+0000 7f45eb7fe640 1 -- 172.21.15.100:0/2962798270 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f45e400f450 con 0x7f45f4100a80 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 Processor -- start 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 -- start start 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45eb7fe640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e00a2c10 0x7f45e00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c0df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c18800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 0x5586c7c1b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5586c7b73280 con 0x5586c7c0e480 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5586c7b1ab10 con 0x5586c7c18d40 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45fabe5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5586c7b6f240 con 0x5586c7c0db60 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e00a2c10 0x7f45e00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45eb7fe640 1 -- 172.21.15.100:0/2962798270 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45e40cf280 con 0x7f45f4100a80 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c18800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c18800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36420/0 (socket says 172.21.15.100:36420) 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.455+0000 7f45ebfff640 1 -- 172.21.15.100:0/3328968689 learned_addr learned my addr 172.21.15.100:0/3328968689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45f259c640 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c0df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45ebfff640 1 -- 172.21.15.100:0/3328968689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 msgr2=0x5586c7c0df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45ebfff640 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c0df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45ebfff640 1 -- 172.21.15.100:0/3328968689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 msgr2=0x5586c7c1b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45ebfff640 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 0x5586c7c1b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45ebfff640 1 -- 172.21.15.100:0/3328968689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c7b271f0 con 0x5586c7c0e480 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45f259c640 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c0df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e00a2c10 0x7f45e00a50d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009a60 tx=0x7f45ec031530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45ebfff640 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c18800 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00aca0 tx=0x7f45dc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dcf4827b0038db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45e8ff9640 1 -- 172.21.15.100:0/3328968689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc01d070 con 0x5586c7c0e480 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45e8ff9640 1 -- 172.21.15.100:0/3328968689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45dc018b20 con 0x5586c7c0e480 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.456+0000 7f45e8ff9640 1 -- 172.21.15.100:0/3328968689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc010c40 con 0x5586c7c0e480 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 -- 172.21.15.100:0/3328968689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 msgr2=0x5586c7c18800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c18800 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00aca0 tx=0x7f45dc00f790 comp rx=0 tx=0).stop 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 -- 172.21.15.100:0/3328968689 shutdown_connections 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 0x5586c7c1b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c18800 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 --2- 172.21.15.100:0/3328968689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c0df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 -- 172.21.15.100:0/3328968689 >> 172.21.15.100:0/3328968689 conn(0x5586c7c0a0f0 msgr2=0x5586c7c0a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 -- 172.21.15.100:0/3328968689 shutdown_connections 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 -- 172.21.15.100:0/3328968689 wait complete. 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 -- start start 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.457+0000 7f45fabe5740 1 Processor -- start 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c15c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c16140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c16680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5586c7c1fd20 con 0x5586c7c18d40 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5586c7b2df10 con 0x5586c7c0e480 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5586c7c1fea0 con 0x5586c7c0db60 2024-09-12T02:06:54.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 10 client.0 _ll_register_callbacks cb 0x5586c7af6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c16680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c16680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36432/0 (socket says 172.21.15.100:36432) 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 -- 172.21.15.100:0/2733680419 learned_addr learned my addr 172.21.15.100:0/2733680419 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f259c640 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c15c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45ebfff640 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c16140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 -- 172.21.15.100:0/2733680419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 msgr2=0x5586c7c15c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c15c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 -- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 msgr2=0x5586c7c16140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c16140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 -- 172.21.15.100:0/2733680419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c78e46a0 con 0x5586c7c18d40 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c16680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009cd0 tx=0x7f45ec02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5196c3f13bda9299 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45d9ffb640 1 -- 172.21.15.100:0/2733680419 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec043070 con 0x5586c7c18d40 2024-09-12T02:06:54.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45d9ffb640 1 -- 172.21.15.100:0/2733680419 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45ec0305a0 con 0x5586c7c18d40 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45dc018b20 con 0x5586c7c18d40 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45d9ffb640 1 -- 172.21.15.100:0/2733680419 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45ec057050 con 0x5586c7c18d40 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 10 client.15210 fetch_fsmap learned FSMap version 24 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.458+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586c7c2b930 con 0x5586c7c18d40 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45d9ffb640 1 -- 172.21.15.100:0/2733680419 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45dc018b20 con 0x5586c7c18d40 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45d9ffb640 1 -- 172.21.15.100:0/2733680419 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45ec030070 con 0x5586c7c18d40 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45fabe5740 10 client.15210 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45fabe5740 10 client.15210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45fabe5740 20 client.15210 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45fabe5740 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c2f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45fabe5740 4 client.15210 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586c7b807f0 con 0x5586c7c2cdf0 2024-09-12T02:06:54.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.459+0000 7f45f259c640 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c2f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.460+0000 7f45f259c640 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c2f240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d23209be5ea176 server_cookie=a27ac0dcc82f4917 in_seq=0 out_seq=0 2024-09-12T02:06:54.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.460+0000 7f45d9ffb640 10 client.15210 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:54.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.460+0000 7f45d9ffb640 1 -- 172.21.15.100:0/2733680419 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586c7b807f0 con 0x5586c7c2cdf0 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.460+0000 7f45d9ffb640 10 client.15210 handle_command_reply: tid=0 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.460+0000 7f45fabe5740 1 client.15210 shutdown 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.460+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 msgr2=0x5586c7c16680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.460+0000 7f45fabe5740 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c16680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009cd0 tx=0x7f45ec02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 shutdown_connections 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c2f240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45d9ffb640 0 client.15210 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c16680 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c16140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 --2- 172.21.15.100:0/2733680419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c15c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 >> 172.21.15.100:0/2733680419 conn(0x5586c7c0a0f0 msgr2=0x5586c7c09270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 shutdown_connections 2024-09-12T02:06:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 1 -- 172.21.15.100:0/2733680419 wait complete. 2024-09-12T02:06:54.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.461+0000 7f45fabe5740 20 client.15210 trim_cache size 0 max 16384 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 Processor -- start 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 -- start start 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c105c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c17a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c34b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41adb50 con 0x5586c7c18d40 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41ab420 con 0x5586c7c0e480 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45fabe5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41a9270 con 0x5586c7c0db60 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c34b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c34b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36442/0 (socket says 172.21.15.100:36442) 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 -- 172.21.15.100:0/570238059 learned_addr learned my addr 172.21.15.100:0/570238059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45ebfff640 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c17a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f259c640 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 -- 172.21.15.100:0/570238059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 msgr2=0x5586c7c105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 -- 172.21.15.100:0/570238059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 msgr2=0x5586c7c17a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c17a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45f2d9d640 1 -- 172.21.15.100:0/570238059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c7c184d0 con 0x5586c7c18d40 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.478+0000 7f45ebfff640 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c17a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.479+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c34b60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45ec02ae00 tx=0x7f45ec0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c38ca9b5819dab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.479+0000 7f45dbfff640 1 -- 172.21.15.100:0/570238059 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0047a0 con 0x5586c7c18d40 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.479+0000 7f45dbfff640 1 -- 172.21.15.100:0/570238059 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45ec036040 con 0x5586c7c18d40 2024-09-12T02:06:54.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.479+0000 7f45dbfff640 1 -- 172.21.15.100:0/570238059 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec030a60 con 0x5586c7c18d40 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.479+0000 7f45fabe5740 1 -- 172.21.15.100:0/570238059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 msgr2=0x5586c7c34b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.479+0000 7f45fabe5740 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c34b60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45ec02ae00 tx=0x7f45ec0095c0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.479+0000 7f45fabe5740 1 -- 172.21.15.100:0/570238059 shutdown_connections 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c18d40 0x5586c7c34b60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c0e480 0x5586c7c17a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 --2- 172.21.15.100:0/570238059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 -- 172.21.15.100:0/570238059 >> 172.21.15.100:0/570238059 conn(0x5586c7c0a0f0 msgr2=0x5586c7c17350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 -- 172.21.15.100:0/570238059 shutdown_connections 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 -- 172.21.15.100:0/570238059 wait complete. 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 -- start start 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 Processor -- start 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c25870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 0x5586c7c12f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41a98e0 con 0x5586c7c0e480 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41aad50 con 0x5586c7c18d40 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41a9fb0 con 0x5586c7c0db60 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45fabe5740 10 client.0 _ll_register_callbacks cb 0x7f45ec009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45f259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c25870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c129c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36448/0 (socket says 172.21.15.100:36448) 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.480+0000 7f45ebfff640 1 -- 172.21.15.100:0/1690831397 learned_addr learned my addr 172.21.15.100:0/1690831397 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45f2d9d640 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 0x5586c7c12f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45ebfff640 1 -- 172.21.15.100:0/1690831397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 msgr2=0x5586c7c25870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45ebfff640 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c25870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45ebfff640 1 -- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 msgr2=0x5586c7c12f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45ebfff640 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 0x5586c7c12f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45ebfff640 1 -- 172.21.15.100:0/1690831397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c7c13730 con 0x5586c7c0e480 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45ebfff640 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c129c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5586c7c0af50 tx=0x7f45dc010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a136901e0587b53a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45d9ffb640 1 -- 172.21.15.100:0/1690831397 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc028070 con 0x5586c7c0e480 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45d9ffb640 1 -- 172.21.15.100:0/1690831397 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45dc005040 con 0x5586c7c0e480 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45ec036040 con 0x5586c7c0e480 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45d9ffb640 1 -- 172.21.15.100:0/1690831397 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45dc034050 con 0x5586c7c0e480 2024-09-12T02:06:54.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45fabe5740 10 client.15216 fetch_fsmap learned FSMap version 24 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586c7c97b40 con 0x5586c7c0e480 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.481+0000 7f45d9ffb640 1 -- 172.21.15.100:0/1690831397 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45ec036040 con 0x5586c7c0e480 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45d9ffb640 1 -- 172.21.15.100:0/1690831397 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45dc023040 con 0x5586c7c0e480 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45fabe5740 10 client.15216 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45fabe5740 10 client.15216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45fabe5740 20 client.15216 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45fabe5740 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c9a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45fabe5740 4 client.15216 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5586c7b7ad00 con 0x5586c7c2cdf0 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45f259c640 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c9a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45f259c640 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c9a050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3affb80869184bc6 server_cookie=bee50bd863480715 in_seq=0 out_seq=0 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.482+0000 7f45d9ffb640 10 client.15216 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45d9ffb640 1 -- 172.21.15.100:0/1690831397 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5586c7b7ad00 con 0x5586c7c2cdf0 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45d9ffb640 10 client.15216 handle_command_reply: tid=0 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 client.15216 shutdown 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 msgr2=0x5586c7c129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c129c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5586c7c0af50 tx=0x7f45dc010880 comp rx=0 tx=0).stop 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 shutdown_connections 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5586c7c2cdf0 0x5586c7c9a050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5586c7c18d40 0x5586c7c12f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586c7c0e480 0x5586c7c129c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 --2- 172.21.15.100:0/1690831397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5586c7c0db60 0x5586c7c25870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45d9ffb640 0 client.15216 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 >> 172.21.15.100:0/1690831397 conn(0x5586c7c0a0f0 msgr2=0x5586c7c17a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 shutdown_connections 2024-09-12T02:06:54.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 1 -- 172.21.15.100:0/1690831397 wait complete. 2024-09-12T02:06:54.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45fabe5740 20 client.15216 trim_cache size 0 max 16384 2024-09-12T02:06:54.489 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:54.489 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:06:54.489 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "aa79c338-65cd-4c72-84bb-a056bb169f44", 2024-09-12T02:06:54.489 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:06:54.489 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e00a2c10 msgr2=0x7f45e00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45f880c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e00a2c10 0x7f45e00a50d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009a60 tx=0x7f45ec031530 comp rx=0 tx=0).stop 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4100a80 msgr2=0x7f45f41991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.484+0000 7f45f880c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4100a80 0x7f45f41991b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c920 tx=0x7f45e400cd20 comp rx=0 tx=0).stop 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 shutdown_connections 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f45e00a2c10 0x7f45e00a50d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45f4106a80 0x7f45f41a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4101420 0x7f45f41996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 --2- 172.21.15.100:0/2962798270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f4100a80 0x7f45f41991b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 >> 172.21.15.100:0/2962798270 conn(0x7f45f40fc7a0 msgr2=0x7f45f40fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 shutdown_connections 2024-09-12T02:06:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.485+0000 7f45f880c640 1 -- 172.21.15.100:0/2962798270 wait complete. 2024-09-12T02:06:54.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:54 smithi189 ceph-mon[35188]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:06:54.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:54 smithi117 ceph-mon[35240]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.876+0000 7f0d7959c640 1 -- 172.21.15.100:0/3306780694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 msgr2=0x7f0d74101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.876+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3306780694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d74101200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009900 tx=0x7f0d6402a480 comp rx=0 tx=0).stop 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.876+0000 7f0d7959c640 1 -- 172.21.15.100:0/3306780694 shutdown_connections 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.876+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3306780694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d74102ef0 0x7f0d7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.876+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3306780694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d74102570 0x7f0d741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.876+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3306780694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d74101200 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.876+0000 7f0d7959c640 1 -- 172.21.15.100:0/3306780694 >> 172.21.15.100:0/3306780694 conn(0x7f0d740fc7d0 msgr2=0x7f0d740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.877+0000 7f0d7959c640 1 -- 172.21.15.100:0/3306780694 shutdown_connections 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.877+0000 7f0d7959c640 1 -- 172.21.15.100:0/3306780694 wait complete. 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.877+0000 7f0d7959c640 1 Processor -- start 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.877+0000 7f0d7959c640 1 -- start start 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.877+0000 7f0d7959c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d741994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.877+0000 7f0d7959c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d74102570 0x7f0d74199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.877+0000 7f0d7959c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d74102ef0 0x7f0d741a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d7959c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d74111020 con 0x7f0d74100e20 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d7959c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d74110ea0 con 0x7f0d74102ef0 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d7959c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d741111a0 con 0x7f0d74102570 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d741994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d741994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36458/0 (socket says 172.21.15.100:36458) 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 -- 172.21.15.100:0/3116792521 learned_addr learned my addr 172.21.15.100:0/3116792521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d727fc640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d74102570 0x7f0d74199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d737fe640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d74102ef0 0x7f0d741a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 -- 172.21.15.100:0/3116792521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d74102570 msgr2=0x7f0d74199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d74102570 0x7f0d74199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 -- 172.21.15.100:0/3116792521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d74102ef0 msgr2=0x7f0d741a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d74102ef0 0x7f0d741a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 -- 172.21.15.100:0/3116792521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d741a4ab0 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d72ffd640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d741994f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d64006010 tx=0x7f0d64003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d5bfff640 1 -- 172.21.15.100:0/3116792521 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6403f070 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d5bfff640 1 -- 172.21.15.100:0/3116792521 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d64031e30 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d741a4c80 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d5bfff640 1 -- 172.21.15.100:0/3116792521 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64035030 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.878+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d741a50d0 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.879+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d74101280 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.881+0000 7f0d5bfff640 1 -- 172.21.15.100:0/3116792521 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0d64042070 con 0x7f0d74100e20 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.881+0000 7f0d5bfff640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0d5c0a2c10 0x7f0d5c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:54.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.882+0000 7f0d727fc640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0d5c0a2c10 0x7f0d5c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.882+0000 7f0d5bfff640 1 -- 172.21.15.100:0/3116792521 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0d640f0160 con 0x7f0d74100e20 2024-09-12T02:06:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.882+0000 7f0d727fc640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0d5c0a2c10 0x7f0d5c0a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d7406aac0 tx=0x7f0d68008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:54.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:54.886+0000 7f0d5bfff640 1 -- 172.21.15.100:0/3116792521 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d640bd000 con 0x7f0d74100e20 2024-09-12T02:06:55.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.051+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d74062630 con 0x7f0d5c0a2c10 2024-09-12T02:06:55.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.058+0000 7f0d5bfff640 1 -- 172.21.15.100:0/3116792521 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258720 (secure 0 0 0) 0x7f0d74062630 con 0x7f0d5c0a2c10 2024-09-12T02:06:55.060 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:55.060 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0d5c0a2c10 msgr2=0x7f0d5c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0d5c0a2c10 0x7f0d5c0a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d7406aac0 tx=0x7f0d68008040 comp rx=0 tx=0).stop 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 msgr2=0x7f0d741994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d741994f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d64006010 tx=0x7f0d64003c80 comp rx=0 tx=0).stop 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 shutdown_connections 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f0d5c0a2c10 0x7f0d5c0a50d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d74102ef0 0x7f0d741a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d74102570 0x7f0d74199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 --2- 172.21.15.100:0/3116792521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d74100e20 0x7f0d741994f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.060+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 >> 172.21.15.100:0/3116792521 conn(0x7f0d740fc7d0 msgr2=0x7f0d740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.061+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 shutdown_connections 2024-09-12T02:06:55.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:55.061+0000 7f0d7959c640 1 -- 172.21.15.100:0/3116792521 wait complete. 2024-09-12T02:06:55.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:55 smithi100 ceph-mon[31179]: scrub queued for path: / 2024-09-12T02:06:55.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:55 smithi100 ceph-mon[31179]: scrub summary: idle+waiting paths [/] 2024-09-12T02:06:55.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:55 smithi100 ceph-mon[31179]: scrub summary: active paths [/] 2024-09-12T02:06:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:55 smithi100 ceph-mon[31179]: scrub summary: idle+waiting paths [/] 2024-09-12T02:06:55.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:55 smithi100 ceph-mon[31179]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:55.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:06:55.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:55 smithi189 ceph-mon[35188]: scrub queued for path: / 2024-09-12T02:06:55.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:55 smithi189 ceph-mon[35188]: scrub summary: idle+waiting paths [/] 2024-09-12T02:06:55.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:55 smithi189 ceph-mon[35188]: scrub summary: active paths [/] 2024-09-12T02:06:55.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:55 smithi189 ceph-mon[35188]: scrub summary: idle+waiting paths [/] 2024-09-12T02:06:55.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:55 smithi189 ceph-mon[35188]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:55.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:55 smithi117 ceph-mon[35240]: scrub queued for path: / 2024-09-12T02:06:55.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:55 smithi117 ceph-mon[35240]: scrub summary: idle+waiting paths [/] 2024-09-12T02:06:55.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:55 smithi117 ceph-mon[35240]: scrub summary: active paths [/] 2024-09-12T02:06:55.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:55 smithi117 ceph-mon[35240]: scrub summary: idle+waiting paths [/] 2024-09-12T02:06:55.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:55 smithi117 ceph-mon[35240]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:55.990 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-09-12T02:06:54.045922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661819,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":729,"num_read_kb":486,"num_write":352,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353572,"kb_used_data":12612,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588252,"statfs":{"total":1151940427776,"available":1151578370048,"internally_reserved":0,"allocated":12914688,"data_stored":7234581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7450,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":49,"num_write":7,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":126,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.897541+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:47.897541+0000","last_peered":"2024-09-12T02:06:47.897541+0000","last_clean":"2024-09-12T02:06:47.897541+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:47.897541+0000","last_undegraded":"2024-09-12T02:06:47.897541+0000","last_fullsized":"2024-09-12T02:06:47.897541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:51.902803+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:51.902803+0000","last_peered":"2024-09-12T02:06:51.902803+0000","last_clean":"2024-09-12T02:06:51.902803+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:51.902803+0000","last_undegraded":"2024-09-12T02:06:51.902803+0000","last_fullsized":"2024-09-12T02:06:51.902803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":258,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.904476+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:52.904476+0000","last_peered":"2024-09-12T02:06:52.904476+0000","last_clean":"2024-09-12T02:06:52.904476+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:52.904476+0000","last_undegraded":"2024-09-12T02:06:52.904476+0000","last_fullsized":"2024-09-12T02:06:52.904476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66906,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":167,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:49.899487+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:49.899487+0000","last_peered":"2024-09-12T02:06:49.899487+0000","last_clean":"2024-09-12T02:06:49.899487+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:49.899487+0000","last_undegraded":"2024-09-12T02:06:49.899487+0000","last_fullsized":"2024-09-12T02:06:49.899487+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275237+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275237+0000","last_peered":"2024-09-12T02:05:23.275237+0000","last_clean":"2024-09-12T02:05:23.275237+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275237+0000","last_undegraded":"2024-09-12T02:05:23.275237+0000","last_fullsized":"2024-09-12T02:05:23.275237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:48.897492+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:48.897492+0000","last_peered":"2024-09-12T02:06:48.897492+0000","last_clean":"2024-09-12T02:06:48.897492+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:48.897492+0000","last_undegraded":"2024-09-12T02:06:48.897492+0000","last_fullsized":"2024-09-12T02:06:48.897492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.116599+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:24.116599+0000","last_peered":"2024-09-12T02:05:24.116599+0000","last_clean":"2024-09-12T02:05:24.116599+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:24.116599+0000","last_undegraded":"2024-09-12T02:05:24.116599+0000","last_fullsized":"2024-09-12T02:05:24.116599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116684+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116684+0000","last_peered":"2024-09-12T02:05:23.116684+0000","last_clean":"2024-09-12T02:05:23.116684+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116684+0000","last_undegraded":"2024-09-12T02:05:23.116684+0000","last_fullsized":"2024-09-12T02:05:23.116684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71217,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":603,"num_read_kb":377,"num_write":169,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716568,"statfs":{"total":95995035648,"available":95965765632,"internally_reserved":0,"allocated":1597440,"data_stored":1096396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972396,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1030089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":505802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":504333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:55.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:06:56.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.514+0000 7f464e076640 1 -- 172.21.15.100:0/1137168299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648102ef0 msgr2=0x7f464810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.514+0000 7f464e076640 1 --2- 172.21.15.100:0/1137168299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648102ef0 0x7f464810da40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4640009ca0 tx=0x7f464002a950 comp rx=0 tx=0).stop 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.514+0000 7f464e076640 1 -- 172.21.15.100:0/1137168299 shutdown_connections 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.514+0000 7f464e076640 1 --2- 172.21.15.100:0/1137168299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648102ef0 0x7f464810da40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.514+0000 7f464e076640 1 --2- 172.21.15.100:0/1137168299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4648102570 0x7f46481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.514+0000 7f464e076640 1 --2- 172.21.15.100:0/1137168299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4648100e20 0x7f4648101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.514+0000 7f464e076640 1 -- 172.21.15.100:0/1137168299 >> 172.21.15.100:0/1137168299 conn(0x7f46480fc7d0 msgr2=0x7f46480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.515+0000 7f464e076640 1 -- 172.21.15.100:0/1137168299 shutdown_connections 2024-09-12T02:06:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.515+0000 7f464e076640 1 -- 172.21.15.100:0/1137168299 wait complete. 2024-09-12T02:06:56.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.515+0000 7f464e076640 1 Processor -- start 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f464e076640 1 -- start start 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f464e076640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648100e20 0x7f46480fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f464e076640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4648102570 0x7f46480fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f464e076640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4648102ef0 0x7f46480fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f464e076640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4648110f80 con 0x7f4648100e20 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f464e076640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4648110e00 con 0x7f4648102570 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f464e076640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4648111100 con 0x7f4648102ef0 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648100e20 0x7f46480fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648100e20 0x7f46480fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36474/0 (socket says 172.21.15.100:36474) 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 -- 172.21.15.100:0/285623256 learned_addr learned my addr 172.21.15.100:0/285623256 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f4647fff640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4648102ef0 0x7f46480fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f4646ffd640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4648102570 0x7f46480fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 -- 172.21.15.100:0/285623256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4648102ef0 msgr2=0x7f46480fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4648102ef0 0x7f46480fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 -- 172.21.15.100:0/285623256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4648102570 msgr2=0x7f46480fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4648102570 0x7f46480fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f46477fe640 1 -- 172.21.15.100:0/285623256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46481a6940 con 0x7f4648100e20 2024-09-12T02:06:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.516+0000 7f4646ffd640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4648102570 0x7f46480fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:56.518 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:56 smithi100 ceph-mon[31179]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.517+0000 7f46477fe640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648100e20 0x7f46480fcc80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f463800d950 tx=0x7f463800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.517+0000 7f4644ff9640 1 -- 172.21.15.100:0/285623256 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638017070 con 0x7f4648100e20 2024-09-12T02:06:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.517+0000 7f4644ff9640 1 -- 172.21.15.100:0/285623256 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4638009c30 con 0x7f4648100e20 2024-09-12T02:06:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.517+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46481a6c30 con 0x7f4648100e20 2024-09-12T02:06:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.517+0000 7f4644ff9640 1 -- 172.21.15.100:0/285623256 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463800f6b0 con 0x7f4648100e20 2024-09-12T02:06:56.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.517+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46481a71c0 con 0x7f4648100e20 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 Processor -- start 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 -- start start 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9e4a0 0x55d7adf9e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9edc0 0x55d7adfa9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfaba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d7adf042e0 con 0x55d7adf9e4a0 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d7adeabce0 con 0x55d7adf9edc0 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f465044f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7adf002a0 con 0x55d7adfa9680 2024-09-12T02:06:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f4644ff9640 1 -- 172.21.15.100:0/285623256 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f46380109d0 con 0x7f4648100e20 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfaba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f4647fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9e4a0 0x55d7adf9e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f46477fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9edc0 0x55d7adfa9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f4647fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9e4a0 0x55d7adf9e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36488/0 (socket says 172.21.15.100:36488) 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.520+0000 7f4647fff640 1 -- 172.21.15.100:0/584583939 learned_addr learned my addr 172.21.15.100:0/584583939 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4646ffd640 1 -- 172.21.15.100:0/584583939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9edc0 msgr2=0x55d7adfa9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4646ffd640 1 --2- 172.21.15.100:0/584583939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9edc0 0x55d7adfa9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4646ffd640 1 -- 172.21.15.100:0/584583939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9e4a0 msgr2=0x55d7adf9e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4646ffd640 1 --2- 172.21.15.100:0/584583939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9e4a0 0x55d7adf9e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4646ffd640 1 -- 172.21.15.100:0/584583939 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ade90440 con 0x55d7adfa9680 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4644ff9640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f46300a2c90 0x7f46300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4646ffd640 1 --2- 172.21.15.100:0/584583939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfaba70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46480fe710 tx=0x7f463c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1082dff9c02cde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4647fff640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f46300a2c90 0x7f46300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f4644ff9640 1 -- 172.21.15.100:0/285623256 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f46380ceda0 con 0x7f4648100e20 2024-09-12T02:06:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f462dffb640 1 -- 172.21.15.100:0/584583939 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c015070 con 0x55d7adfa9680 2024-09-12T02:06:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f462dffb640 1 -- 172.21.15.100:0/584583939 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f463c005500 con 0x55d7adfa9680 2024-09-12T02:06:56.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.521+0000 7f462dffb640 1 -- 172.21.15.100:0/584583939 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c011440 con 0x55d7adfa9680 2024-09-12T02:06:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 -- 172.21.15.100:0/584583939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 msgr2=0x55d7adfaba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 --2- 172.21.15.100:0/584583939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfaba70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46480fe710 tx=0x7f463c00f730 comp rx=0 tx=0).stop 2024-09-12T02:06:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f4647fff640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f46300a2c90 0x7f46300a5150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4640009430 tx=0x7f4640005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 -- 172.21.15.100:0/584583939 shutdown_connections 2024-09-12T02:06:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 --2- 172.21.15.100:0/584583939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfaba70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 --2- 172.21.15.100:0/584583939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9edc0 0x55d7adfa9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 --2- 172.21.15.100:0/584583939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9e4a0 0x55d7adf9e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 -- 172.21.15.100:0/584583939 >> 172.21.15.100:0/584583939 conn(0x55d7adf9aa30 msgr2=0x55d7adf9ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 -- 172.21.15.100:0/584583939 shutdown_connections 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.522+0000 7f465044f740 1 -- 172.21.15.100:0/584583939 wait complete. 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 -- start start 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 Processor -- start 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfa8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfa6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d7adfac250 con 0x55d7adf9edc0 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d7adebf050 con 0x55d7adf9e4a0 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7adfac3d0 con 0x55d7adfa9680 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f465044f740 10 client.0 _ll_register_callbacks cb 0x55d7adeff160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36504/0 (socket says 172.21.15.100:36504) 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f4646ffd640 1 -- 172.21.15.100:0/3817557537 learned_addr learned my addr 172.21.15.100:0/3817557537 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f46477fe640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfa8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.523+0000 7f4647fff640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfa6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4647fff640 1 -- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 msgr2=0x55d7adfa8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4647fff640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfa8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4647fff640 1 -- 172.21.15.100:0/3817557537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 msgr2=0x55d7adfa6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4647fff640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4647fff640 1 -- 172.21.15.100:0/3817557537 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7adc753c0 con 0x55d7adfa9680 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4646ffd640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4647fff640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfa6760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f464002ae70 tx=0x7f46400095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41aae0786c4394a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:06:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.524+0000 7f4626ffd640 1 -- 172.21.15.100:0/3817557537 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640055060 con 0x55d7adfa9680 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f463c005500 con 0x55d7adfa9680 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f4626ffd640 1 -- 172.21.15.100:0/3817557537 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4640003fc0 con 0x55d7adfa9680 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f4626ffd640 1 -- 172.21.15.100:0/3817557537 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4640034040 con 0x55d7adfa9680 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 10 client.24754 fetch_fsmap learned FSMap version 24 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d7adfb7c70 con 0x55d7adfa9680 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f4626ffd640 1 -- 172.21.15.100:0/3817557537 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f463c005500 con 0x55d7adfa9680 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f4626ffd640 1 -- 172.21.15.100:0/3817557537 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4640030ac0 con 0x55d7adfa9680 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 10 client.24754 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 10 client.24754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 20 client.24754 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7adfb9080 0x55d7adfbb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 4 client.24754 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:06:56.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.525+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7adf11850 con 0x55d7adfb9080 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.526+0000 7f46477fe640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7adfb9080 0x55d7adfbb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.526+0000 7f46477fe640 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7adfb9080 0x55d7adfbb500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=501c7fe1bdaeb474 server_cookie=aefc6a083f3b7efe in_seq=0 out_seq=0 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.526+0000 7f4626ffd640 10 client.24754 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f4626ffd640 1 -- 172.21.15.100:0/3817557537 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7adf11850 con 0x55d7adfb9080 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f4626ffd640 10 client.24754 handle_command_reply: tid=0 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 client.24754 shutdown 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 msgr2=0x55d7adfa6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfa6760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f464002ae70 tx=0x7f46400095c0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 shutdown_connections 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7adfb9080 0x55d7adfbb500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfa6760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f4626ffd640 0 client.24754 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 --2- 172.21.15.100:0/3817557537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfa8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 >> 172.21.15.100:0/3817557537 conn(0x55d7adf9aa30 msgr2=0x55d7adfa0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 shutdown_connections 2024-09-12T02:06:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 1 -- 172.21.15.100:0/3817557537 wait complete. 2024-09-12T02:06:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.527+0000 7f465044f740 20 client.24754 trim_cache size 0 max 16384 2024-09-12T02:06:56.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.545+0000 7f465044f740 1 Processor -- start 2024-09-12T02:06:56.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.545+0000 7f465044f740 1 -- start start 2024-09-12T02:06:56.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.545+0000 7f465044f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.545+0000 7f465044f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f465044f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfc0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f465044f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46481b2070 con 0x55d7adf9edc0 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f465044f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46481af940 con 0x55d7adf9e4a0 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f465044f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46481ad790 con 0x55d7adfa9680 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36518/0 (socket says 172.21.15.100:36518) 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 -- 172.21.15.100:0/3118511469 learned_addr learned my addr 172.21.15.100:0/3118511469 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f46477fe640 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4647fff640 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfc0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 -- 172.21.15.100:0/3118511469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 msgr2=0x55d7adfc0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfc0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 -- 172.21.15.100:0/3118511469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 msgr2=0x55d7adfb5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 -- 172.21.15.100:0/3118511469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7adfa51d0 con 0x55d7adf9edc0 2024-09-12T02:06:56.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f4646ffd640 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa8190 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f463c004cb0 tx=0x7f463c005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316fa4546b5d73ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.548 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.546+0000 7f462d7fa640 1 -- 172.21.15.100:0/3118511469 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c029070 con 0x55d7adf9edc0 2024-09-12T02:06:56.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f462d7fa640 1 -- 172.21.15.100:0/3118511469 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f463c004d50 con 0x55d7adf9edc0 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f462d7fa640 1 -- 172.21.15.100:0/3118511469 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c015050 con 0x55d7adf9edc0 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 -- 172.21.15.100:0/3118511469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 msgr2=0x55d7adfa8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa8190 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f463c004cb0 tx=0x7f463c005fb0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 -- 172.21.15.100:0/3118511469 shutdown_connections 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adfa9680 0x55d7adfc0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfa8190 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 --2- 172.21.15.100:0/3118511469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 -- 172.21.15.100:0/3118511469 >> 172.21.15.100:0/3118511469 conn(0x55d7adf9aa30 msgr2=0x55d7adfa7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 -- 172.21.15.100:0/3118511469 shutdown_connections 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.547+0000 7f465044f740 1 -- 172.21.15.100:0/3118511469 wait complete. 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 -- start start 2024-09-12T02:06:56.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 Processor -- start 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfb1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adfa9680 0x55d7adfadde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46481ade00 con 0x55d7adf9edc0 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46481af270 con 0x55d7adfa9680 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46481ae4d0 con 0x55d7adf9e4a0 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.548+0000 7f465044f740 10 client.0 _ll_register_callbacks cb 0x7f464002f3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfb1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfb1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36524/0 (socket says 172.21.15.100:36524) 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 -- 172.21.15.100:0/1555157973 learned_addr learned my addr 172.21.15.100:0/1555157973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f46477fe640 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4647fff640 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adfa9680 0x55d7adfadde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 -- 172.21.15.100:0/1555157973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adf9e4a0 msgr2=0x55d7adfb19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 -- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adfa9680 msgr2=0x55d7adfadde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adfa9680 0x55d7adfadde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 -- 172.21.15.100:0/1555157973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7adfae610 con 0x55d7adf9edc0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4646ffd640 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfb1f10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f463c00f770 tx=0x7f463c004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effd437278bcdee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4626ffd640 1 -- 172.21.15.100:0/1555157973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c029040 con 0x55d7adf9edc0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f4626ffd640 1 -- 172.21.15.100:0/1555157973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f463c004f00 con 0x55d7adf9edc0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.549+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f463c004d50 con 0x55d7adf9edc0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f4626ffd640 1 -- 172.21.15.100:0/1555157973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f463c004b00 con 0x55d7adf9edc0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 10 client.15240 fetch_fsmap learned FSMap version 24 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d7ae0249c0 con 0x55d7adf9edc0 2024-09-12T02:06:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f4626ffd640 1 -- 172.21.15.100:0/1555157973 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f463c004d50 con 0x55d7adf9edc0 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f4626ffd640 1 -- 172.21.15.100:0/1555157973 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f463c02c070 con 0x55d7adf9edc0 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 10 client.15240 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 10 client.15240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 20 client.15240 populate_metadata read hostname 'smithi100' 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7ae024de0 0x55d7ae0271d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 4 client.15240 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d7adf0bd60 con 0x55d7ae024de0 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.550+0000 7f46477fe640 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7ae024de0 0x55d7ae0271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f4626ffd640 10 client.15240 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f46477fe640 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7ae024de0 0x55d7ae0271d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b4e16a51a29fc79 server_cookie=fe025cd9a2363bb4 in_seq=0 out_seq=0 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f4626ffd640 1 -- 172.21.15.100:0/1555157973 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d7adf0bd60 con 0x55d7ae024de0 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f4626ffd640 10 client.15240 handle_command_reply: tid=0 2024-09-12T02:06:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 client.15240 shutdown 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 msgr2=0x55d7adfb1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfb1f10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f463c00f770 tx=0x7f463c004910 comp rx=0 tx=0).stop 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 shutdown_connections 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d7ae024de0 0x55d7ae0271d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d7adfa9680 0x55d7adfadde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7adf9edc0 0x55d7adfb1f10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 --2- 172.21.15.100:0/1555157973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7adf9e4a0 0x55d7adfb19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 >> 172.21.15.100:0/1555157973 conn(0x55d7adf9aa30 msgr2=0x55d7adf99b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f4626ffd640 0 client.15240 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 shutdown_connections 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.551+0000 7f465044f740 1 -- 172.21.15.100:0/1555157973 wait complete. 2024-09-12T02:06:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f465044f740 20 client.15240 trim_cache size 0 max 16384 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: "aa79c338-65cd-4c72-84bb-a056bb169f44": { 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "aa79c338-65cd-4c72-84bb-a056bb169f44", 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:06:56.557 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:06:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f46300a2c90 msgr2=0x7f46300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f46300a2c90 0x7f46300a5150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4640009430 tx=0x7f4640005c50 comp rx=0 tx=0).stop 2024-09-12T02:06:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648100e20 msgr2=0x7f46480fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648100e20 0x7f46480fcc80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f463800d950 tx=0x7f463800de10 comp rx=0 tx=0).stop 2024-09-12T02:06:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 shutdown_connections 2024-09-12T02:06:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f46300a2c90 0x7f46300a5150 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4648102ef0 0x7f46480fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4648102570 0x7f46480fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 --2- 172.21.15.100:0/285623256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4648100e20 0x7f46480fcc80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.552+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 >> 172.21.15.100:0/285623256 conn(0x7f46480fc7d0 msgr2=0x7f464806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.553+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 shutdown_connections 2024-09-12T02:06:56.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:56.553+0000 7f464e076640 1 -- 172.21.15.100:0/285623256 wait complete. 2024-09-12T02:06:56.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:56 smithi189 ceph-mon[35188]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:56.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:56 smithi117 ceph-mon[35240]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:57.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/2291408894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 msgr2=0x7fbcd8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/2291408894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd8101200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009900 tx=0x7fbcc802a480 comp rx=0 tx=0).stop 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/2291408894 shutdown_connections 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/2291408894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8102ef0 0x7fbcd810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/2291408894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcd8102570 0x7fbcd81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/2291408894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd8101200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/2291408894 >> 172.21.15.100:0/2291408894 conn(0x7fbcd80fc7d0 msgr2=0x7fbcd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/2291408894 shutdown_connections 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.231+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/2291408894 wait complete. 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 Processor -- start 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 -- start start 2024-09-12T02:06:57.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8102570 0x7fbcd8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcd8102ef0 0x7fbcd819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8110f80 con 0x7fbcd8100e20 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8110e00 con 0x7fbcd8102570 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.232+0000 7fbcdd3aa640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8111100 con 0x7fbcd8102ef0 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd81985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36548/0 (socket says 172.21.15.100:36548) 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 -- 172.21.15.100:0/113731235 learned_addr learned my addr 172.21.15.100:0/113731235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd77fe640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcd8102ef0 0x7fbcd819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcce7fc640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8102570 0x7fbcd8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 -- 172.21.15.100:0/113731235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcd8102ef0 msgr2=0x7fbcd819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcd8102ef0 0x7fbcd819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 -- 172.21.15.100:0/113731235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8102570 msgr2=0x7fbcd8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8102570 0x7fbcd8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 -- 172.21.15.100:0/113731235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd819d570 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcce7fc640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8102570 0x7fbcd8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd6ffd640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd81985c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8006010 tx=0x7fbcc8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd4ff9640 1 -- 172.21.15.100:0/113731235 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc803f070 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd4ff9640 1 -- 172.21.15.100:0/113731235 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcc8031c30 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd819d800 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcd4ff9640 1 -- 172.21.15.100:0/113731235 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8035030 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.233+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd81a5140 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.234+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd8101200 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.235+0000 7fbcd4ff9640 1 -- 172.21.15.100:0/113731235 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbcc8042070 con 0x7fbcd8100e20 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.236+0000 7fbcd4ff9640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbcc40a2c10 0x7fbcc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.236+0000 7fbcce7fc640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbcc40a2c10 0x7fbcc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:57.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.236+0000 7fbcd4ff9640 1 -- 172.21.15.100:0/113731235 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbcc80efee0 con 0x7fbcd8100e20 2024-09-12T02:06:57.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.237+0000 7fbcce7fc640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbcc40a2c10 0x7fbcc40a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80ffd80 tx=0x7fbcc0005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:57.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.239+0000 7fbcd4ff9640 1 -- 172.21.15.100:0/113731235 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbcc8031de0 con 0x7fbcd8100e20 2024-09-12T02:06:57.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.408+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcd81068a0 con 0x7fbcc40a2c10 2024-09-12T02:06:57.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.415+0000 7fbcd4ff9640 1 -- 172.21.15.100:0/113731235 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258721 (secure 0 0 0) 0x7fbcd81068a0 con 0x7fbcc40a2c10 2024-09-12T02:06:57.417 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:57.418 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:57.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbcc40a2c10 msgr2=0x7fbcc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbcc40a2c10 0x7fbcc40a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80ffd80 tx=0x7fbcc0005d30 comp rx=0 tx=0).stop 2024-09-12T02:06:57.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 msgr2=0x7fbcd81985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:57.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd81985c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8006010 tx=0x7fbcc8003c10 comp rx=0 tx=0).stop 2024-09-12T02:06:57.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 shutdown_connections 2024-09-12T02:06:57.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbcc40a2c10 0x7fbcc40a50d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcd8102ef0 0x7fbcd819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8102570 0x7fbcd8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 --2- 172.21.15.100:0/113731235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd8100e20 0x7fbcd81985c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:57.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.417+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 >> 172.21.15.100:0/113731235 conn(0x7fbcd80fc7d0 msgr2=0x7fbcd806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:57.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.418+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 shutdown_connections 2024-09-12T02:06:57.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:57.418+0000 7fbcdd3aa640 1 -- 172.21.15.100:0/113731235 wait complete. 2024-09-12T02:06:57.837 INFO:tasks.cephfs.filesystem:scrub status for tag:aa79c338-65cd-4c72-84bb-a056bb169f44 - {'path': '/', 'tag': 'aa79c338-65cd-4c72-84bb-a056bb169f44', 'options': 'recursive,force'} 2024-09-12T02:06:58.644 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-12T02:06:56.046299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661819,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":739,"num_read_kb":491,"num_write":352,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353572,"kb_used_data":12612,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588252,"statfs":{"total":1151940427776,"available":1151578370048,"internally_reserved":0,"allocated":12914688,"data_stored":7234581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7450,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":44,"num_write":7,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007306"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.905366+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:52.905366+0000","last_peered":"2024-09-12T02:06:52.905366+0000","last_clean":"2024-09-12T02:06:52.905366+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:52.905366+0000","last_undegraded":"2024-09-12T02:06:52.905366+0000","last_fullsized":"2024-09-12T02:06:52.905366+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:51.902803+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:51.902803+0000","last_peered":"2024-09-12T02:06:51.902803+0000","last_clean":"2024-09-12T02:06:51.902803+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:51.902803+0000","last_undegraded":"2024-09-12T02:06:51.902803+0000","last_fullsized":"2024-09-12T02:06:51.902803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":258,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.904476+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:52.904476+0000","last_peered":"2024-09-12T02:06:52.904476+0000","last_clean":"2024-09-12T02:06:52.904476+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:52.904476+0000","last_undegraded":"2024-09-12T02:06:52.904476+0000","last_fullsized":"2024-09-12T02:06:52.904476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66906,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":167,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:49.899487+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:49.899487+0000","last_peered":"2024-09-12T02:06:49.899487+0000","last_clean":"2024-09-12T02:06:49.899487+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:49.899487+0000","last_undegraded":"2024-09-12T02:06:49.899487+0000","last_fullsized":"2024-09-12T02:06:49.899487+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275237+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275237+0000","last_peered":"2024-09-12T02:05:23.275237+0000","last_clean":"2024-09-12T02:05:23.275237+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275237+0000","last_undegraded":"2024-09-12T02:05:23.275237+0000","last_fullsized":"2024-09-12T02:05:23.275237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.903648+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:52.903648+0000","last_peered":"2024-09-12T02:06:52.903648+0000","last_clean":"2024-09-12T02:06:52.903648+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:52.903648+0000","last_undegraded":"2024-09-12T02:06:52.903648+0000","last_fullsized":"2024-09-12T02:06:52.903648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.116599+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:24.116599+0000","last_peered":"2024-09-12T02:05:24.116599+0000","last_clean":"2024-09-12T02:05:24.116599+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:24.116599+0000","last_undegraded":"2024-09-12T02:05:24.116599+0000","last_fullsized":"2024-09-12T02:05:24.116599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116837+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116837+0000","last_peered":"2024-09-12T02:05:23.116837+0000","last_clean":"2024-09-12T02:05:23.116837+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116837+0000","last_undegraded":"2024-09-12T02:05:23.116837+0000","last_fullsized":"2024-09-12T02:05:23.116837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71217,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":613,"num_read_kb":382,"num_write":169,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716568,"statfs":{"total":95995035648,"available":95965765632,"internally_reserved":0,"allocated":1597440,"data_stored":1096396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234034,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1030089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":505802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":504333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:58.648 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:06:58.649 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:06:58.896 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:06:59.294 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:59 smithi100 ceph-mon[31179]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:59.294 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:06:59 smithi100 ceph-mon[31179]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 -- 172.21.15.100:0/36158934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24108300 msgr2=0x7fed2410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 --2- 172.21.15.100:0/36158934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24108300 0x7fed2410ec70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009cd0 tx=0x7fed1c02a8d0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 -- 172.21.15.100:0/36158934 shutdown_connections 2024-09-12T02:06:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 --2- 172.21.15.100:0/36158934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24108300 0x7fed2410ec70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 --2- 172.21.15.100:0/36158934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed24103780 0x7fed24107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 --2- 172.21.15.100:0/36158934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed24102dd0 0x7fed241031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 -- 172.21.15.100:0/36158934 >> 172.21.15.100:0/36158934 conn(0x7fed240fc7d0 msgr2=0x7fed240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 -- 172.21.15.100:0/36158934 shutdown_connections 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.376+0000 7fed2adf2640 1 -- 172.21.15.100:0/36158934 wait complete. 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 Processor -- start 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 -- start start 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed24102dd0 0x7fed241984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24103780 0x7fed24198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed24108300 0x7fed2419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fed241120d0 con 0x7fed24103780 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fed24111f50 con 0x7fed24102dd0 2024-09-12T02:06:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed2adf2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fed24112250 con 0x7fed24108300 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24103780 0x7fed24198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24103780 0x7fed24198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36554/0 (socket says 172.21.15.100:36554) 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 -- 172.21.15.100:0/3095956335 learned_addr learned my addr 172.21.15.100:0/3095956335 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed28b8e640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed24102dd0 0x7fed241984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 -- 172.21.15.100:0/3095956335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed24108300 msgr2=0x7fed2419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed24108300 0x7fed2419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 -- 172.21.15.100:0/3095956335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed24102dd0 msgr2=0x7fed241984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed24102dd0 0x7fed241984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 -- 172.21.15.100:0/3095956335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2419d470 con 0x7fed24103780 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.377+0000 7fed23fff640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24103780 0x7fed24198a00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed1000d740 tx=0x7fed1000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.378+0000 7fed21ffb640 1 -- 172.21.15.100:0/3095956335 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10017070 con 0x7fed24103780 2024-09-12T02:06:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.378+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2419d760 con 0x7fed24103780 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.378+0000 7fed21ffb640 1 -- 172.21.15.100:0/3095956335 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed1000de50 con 0x7fed24103780 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.378+0000 7fed21ffb640 1 -- 172.21.15.100:0/3095956335 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1000f6b0 con 0x7fed24103780 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.378+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed241a5040 con 0x7fed24103780 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.379+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed241031b0 con 0x7fed24103780 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.380+0000 7fed21ffb640 1 -- 172.21.15.100:0/3095956335 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fed1001a070 con 0x7fed24103780 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.381+0000 7fed21ffb640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fed140a2c10 0x7fed140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.381+0000 7fed21ffb640 1 -- 172.21.15.100:0/3095956335 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fed100cebe0 con 0x7fed24103780 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.381+0000 7fed28b8e640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fed140a2c10 0x7fed140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.381+0000 7fed28b8e640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fed140a2c10 0x7fed140a50d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fed18005e10 tx=0x7fed18005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.384+0000 7fed21ffb640 1 -- 172.21.15.100:0/3095956335 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed1009b9f0 con 0x7fed24103780 2024-09-12T02:06:59.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:59 smithi117 ceph-mon[35240]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:06:59 smithi117 ceph-mon[35240]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:06:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.553+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 --> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed24062630 con 0x7fed140a2c10 2024-09-12T02:06:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.559+0000 7fed21ffb640 1 -- 172.21.15.100:0/3095956335 <== mgr.14150 v2:172.21.15.100:6800/3532459665 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258722 (secure 0 0 0) 0x7fed24062630 con 0x7fed140a2c10 2024-09-12T02:06:59.562 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:06:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-12T02:06:59.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fed140a2c10 msgr2=0x7fed140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fed140a2c10 0x7fed140a50d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fed18005e10 tx=0x7fed18005da0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24103780 msgr2=0x7fed24198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24103780 0x7fed24198a00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed1000d740 tx=0x7fed1000dc00 comp rx=0 tx=0).stop 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 shutdown_connections 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fed140a2c10 0x7fed140a50d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed24108300 0x7fed2419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed24103780 0x7fed24198a00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 --2- 172.21.15.100:0/3095956335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed24102dd0 0x7fed241984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 >> 172.21.15.100:0/3095956335 conn(0x7fed240fc7d0 msgr2=0x7fed24105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 shutdown_connections 2024-09-12T02:06:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:06:59.563+0000 7fed2adf2640 1 -- 172.21.15.100:0/3095956335 wait complete. 2024-09-12T02:06:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:59 smithi189 ceph-mon[35188]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:06:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:06:59 smithi189 ceph-mon[35188]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T02:07:00.370 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-09-12T02:06:58.046761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661819,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":744,"num_read_kb":491,"num_write":352,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353572,"kb_used_data":12612,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588252,"statfs":{"total":1151940427776,"available":1151578370048,"internally_reserved":0,"allocated":12914688,"data_stored":7234581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7450,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":39,"num_write":7,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007300"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116967+0000","last_change":"2024-09-12T02:05:07.051573+0000","last_active":"2024-09-12T02:05:23.116967+0000","last_peered":"2024-09-12T02:05:23.116967+0000","last_clean":"2024-09-12T02:05:23.116967+0000","last_became_active":"2024-09-12T02:05:07.051174+0000","last_became_peered":"2024-09-12T02:05:07.051174+0000","last_unstale":"2024-09-12T02:05:23.116967+0000","last_undegraded":"2024-09-12T02:05:23.116967+0000","last_fullsized":"2024-09-12T02:05:23.116967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116568+0000","last_change":"2024-09-12T02:05:07.050578+0000","last_active":"2024-09-12T02:05:23.116568+0000","last_peered":"2024-09-12T02:05:23.116568+0000","last_clean":"2024-09-12T02:05:23.116568+0000","last_became_active":"2024-09-12T02:05:07.047897+0000","last_became_peered":"2024-09-12T02:05:07.047897+0000","last_unstale":"2024-09-12T02:05:23.116568+0000","last_undegraded":"2024-09-12T02:05:23.116568+0000","last_fullsized":"2024-09-12T02:05:23.116568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:03.257736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116332+0000","last_change":"2024-09-12T02:05:07.039899+0000","last_active":"2024-09-12T02:05:23.116332+0000","last_peered":"2024-09-12T02:05:23.116332+0000","last_clean":"2024-09-12T02:05:23.116332+0000","last_became_active":"2024-09-12T02:05:07.039278+0000","last_became_peered":"2024-09-12T02:05:07.039278+0000","last_unstale":"2024-09-12T02:05:23.116332+0000","last_undegraded":"2024-09-12T02:05:23.116332+0000","last_fullsized":"2024-09-12T02:05:23.116332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:19.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114295+0000","last_change":"2024-09-12T02:05:07.046418+0000","last_active":"2024-09-12T02:05:23.114295+0000","last_peered":"2024-09-12T02:05:23.114295+0000","last_clean":"2024-09-12T02:05:23.114295+0000","last_became_active":"2024-09-12T02:05:07.045836+0000","last_became_peered":"2024-09-12T02:05:07.045836+0000","last_unstale":"2024-09-12T02:05:23.114295+0000","last_undegraded":"2024-09-12T02:05:23.114295+0000","last_fullsized":"2024-09-12T02:05:23.114295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.150961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120505+0000","last_change":"2024-09-12T02:05:07.043019+0000","last_active":"2024-09-12T02:05:23.120505+0000","last_peered":"2024-09-12T02:05:23.120505+0000","last_clean":"2024-09-12T02:05:23.120505+0000","last_became_active":"2024-09-12T02:05:07.042703+0000","last_became_peered":"2024-09-12T02:05:07.042703+0000","last_unstale":"2024-09-12T02:05:23.120505+0000","last_undegraded":"2024-09-12T02:05:23.120505+0000","last_fullsized":"2024-09-12T02:05:23.120505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.065643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335377+0000","last_change":"2024-09-12T02:05:07.043839+0000","last_active":"2024-09-12T02:05:23.335377+0000","last_peered":"2024-09-12T02:05:23.335377+0000","last_clean":"2024-09-12T02:05:23.335377+0000","last_became_active":"2024-09-12T02:05:07.043545+0000","last_became_peered":"2024-09-12T02:05:07.043545+0000","last_unstale":"2024-09-12T02:05:23.335377+0000","last_undegraded":"2024-09-12T02:05:23.335377+0000","last_fullsized":"2024-09-12T02:05:23.335377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:47.832821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274903+0000","last_change":"2024-09-12T02:05:07.045588+0000","last_active":"2024-09-12T02:05:23.274903+0000","last_peered":"2024-09-12T02:05:23.274903+0000","last_clean":"2024-09-12T02:05:23.274903+0000","last_became_active":"2024-09-12T02:05:07.044553+0000","last_became_peered":"2024-09-12T02:05:07.044553+0000","last_unstale":"2024-09-12T02:05:23.274903+0000","last_undegraded":"2024-09-12T02:05:23.274903+0000","last_fullsized":"2024-09-12T02:05:23.274903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:53.916019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121280+0000","last_change":"2024-09-12T02:05:07.049135+0000","last_active":"2024-09-12T02:05:23.121280+0000","last_peered":"2024-09-12T02:05:23.121280+0000","last_clean":"2024-09-12T02:05:23.121280+0000","last_became_active":"2024-09-12T02:05:07.046766+0000","last_became_peered":"2024-09-12T02:05:07.046766+0000","last_unstale":"2024-09-12T02:05:23.121280+0000","last_undegraded":"2024-09-12T02:05:23.121280+0000","last_fullsized":"2024-09-12T02:05:23.121280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:49.669765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119577+0000","last_change":"2024-09-12T02:05:07.047139+0000","last_active":"2024-09-12T02:05:23.119577+0000","last_peered":"2024-09-12T02:05:23.119577+0000","last_clean":"2024-09-12T02:05:23.119577+0000","last_became_active":"2024-09-12T02:05:07.046828+0000","last_became_peered":"2024-09-12T02:05:07.046828+0000","last_unstale":"2024-09-12T02:05:23.119577+0000","last_undegraded":"2024-09-12T02:05:23.119577+0000","last_fullsized":"2024-09-12T02:05:23.119577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:34.669901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335753+0000","last_change":"2024-09-12T02:05:07.049808+0000","last_active":"2024-09-12T02:05:23.335753+0000","last_peered":"2024-09-12T02:05:23.335753+0000","last_clean":"2024-09-12T02:05:23.335753+0000","last_became_active":"2024-09-12T02:05:07.048338+0000","last_became_peered":"2024-09-12T02:05:07.048338+0000","last_unstale":"2024-09-12T02:05:23.335753+0000","last_undegraded":"2024-09-12T02:05:23.335753+0000","last_fullsized":"2024-09-12T02:05:23.335753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.567393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275108+0000","last_change":"2024-09-12T02:05:07.053208+0000","last_active":"2024-09-12T02:05:23.275108+0000","last_peered":"2024-09-12T02:05:23.275108+0000","last_clean":"2024-09-12T02:05:23.275108+0000","last_became_active":"2024-09-12T02:05:07.052720+0000","last_became_peered":"2024-09-12T02:05:07.052720+0000","last_unstale":"2024-09-12T02:05:23.275108+0000","last_undegraded":"2024-09-12T02:05:23.275108+0000","last_fullsized":"2024-09-12T02:05:23.275108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114402+0000","last_change":"2024-09-12T02:05:07.046123+0000","last_active":"2024-09-12T02:05:23.114402+0000","last_peered":"2024-09-12T02:05:23.114402+0000","last_clean":"2024-09-12T02:05:23.114402+0000","last_became_active":"2024-09-12T02:05:07.045327+0000","last_became_peered":"2024-09-12T02:05:07.045327+0000","last_unstale":"2024-09-12T02:05:23.114402+0000","last_undegraded":"2024-09-12T02:05:23.114402+0000","last_fullsized":"2024-09-12T02:05:23.114402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:42.487539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113042+0000","last_change":"2024-09-12T02:05:07.047590+0000","last_active":"2024-09-12T02:05:23.113042+0000","last_peered":"2024-09-12T02:05:23.113042+0000","last_clean":"2024-09-12T02:05:23.113042+0000","last_became_active":"2024-09-12T02:05:07.047287+0000","last_became_peered":"2024-09-12T02:05:07.047287+0000","last_unstale":"2024-09-12T02:05:23.113042+0000","last_undegraded":"2024-09-12T02:05:23.113042+0000","last_fullsized":"2024-09-12T02:05:23.113042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:19.576587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115978+0000","last_change":"2024-09-12T02:05:07.045974+0000","last_active":"2024-09-12T02:05:23.115978+0000","last_peered":"2024-09-12T02:05:23.115978+0000","last_clean":"2024-09-12T02:05:23.115978+0000","last_became_active":"2024-09-12T02:05:07.044881+0000","last_became_peered":"2024-09-12T02:05:07.044881+0000","last_unstale":"2024-09-12T02:05:23.115978+0000","last_undegraded":"2024-09-12T02:05:23.115978+0000","last_fullsized":"2024-09-12T02:05:23.115978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.078741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116093+0000","last_change":"2024-09-12T02:05:07.047204+0000","last_active":"2024-09-12T02:05:23.116093+0000","last_peered":"2024-09-12T02:05:23.116093+0000","last_clean":"2024-09-12T02:05:23.116093+0000","last_became_active":"2024-09-12T02:05:07.046887+0000","last_became_peered":"2024-09-12T02:05:07.046887+0000","last_unstale":"2024-09-12T02:05:23.116093+0000","last_undegraded":"2024-09-12T02:05:23.116093+0000","last_fullsized":"2024-09-12T02:05:23.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.392116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118922+0000","last_change":"2024-09-12T02:05:07.043296+0000","last_active":"2024-09-12T02:05:23.118922+0000","last_peered":"2024-09-12T02:05:23.118922+0000","last_clean":"2024-09-12T02:05:23.118922+0000","last_became_active":"2024-09-12T02:05:07.042353+0000","last_became_peered":"2024-09-12T02:05:07.042353+0000","last_unstale":"2024-09-12T02:05:23.118922+0000","last_undegraded":"2024-09-12T02:05:23.118922+0000","last_fullsized":"2024-09-12T02:05:23.118922+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:46.200049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117062+0000","last_change":"2024-09-12T02:05:07.052040+0000","last_active":"2024-09-12T02:05:23.117062+0000","last_peered":"2024-09-12T02:05:23.117062+0000","last_clean":"2024-09-12T02:05:23.117062+0000","last_became_active":"2024-09-12T02:05:07.051735+0000","last_became_peered":"2024-09-12T02:05:07.051735+0000","last_unstale":"2024-09-12T02:05:23.117062+0000","last_undegraded":"2024-09-12T02:05:23.117062+0000","last_fullsized":"2024-09-12T02:05:23.117062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:35.656108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116334+0000","last_change":"2024-09-12T02:05:07.044463+0000","last_active":"2024-09-12T02:05:23.116334+0000","last_peered":"2024-09-12T02:05:23.116334+0000","last_clean":"2024-09-12T02:05:23.116334+0000","last_became_active":"2024-09-12T02:05:07.044150+0000","last_became_peered":"2024-09-12T02:05:07.044150+0000","last_unstale":"2024-09-12T02:05:23.116334+0000","last_undegraded":"2024-09-12T02:05:23.116334+0000","last_fullsized":"2024-09-12T02:05:23.116334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:47.102454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115565+0000","last_change":"2024-09-12T02:05:07.045376+0000","last_active":"2024-09-12T02:05:23.115565+0000","last_peered":"2024-09-12T02:05:23.115565+0000","last_clean":"2024-09-12T02:05:23.115565+0000","last_became_active":"2024-09-12T02:05:07.044968+0000","last_became_peered":"2024-09-12T02:05:07.044968+0000","last_unstale":"2024-09-12T02:05:23.115565+0000","last_undegraded":"2024-09-12T02:05:23.115565+0000","last_fullsized":"2024-09-12T02:05:23.115565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:47.796245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117040+0000","last_change":"2024-09-12T02:05:07.046378+0000","last_active":"2024-09-12T02:05:23.117040+0000","last_peered":"2024-09-12T02:05:23.117040+0000","last_clean":"2024-09-12T02:05:23.117040+0000","last_became_active":"2024-09-12T02:05:07.046098+0000","last_became_peered":"2024-09-12T02:05:07.046098+0000","last_unstale":"2024-09-12T02:05:23.117040+0000","last_undegraded":"2024-09-12T02:05:23.117040+0000","last_fullsized":"2024-09-12T02:05:23.117040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:05.170507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.113089+0000","last_change":"2024-09-12T02:05:07.042346+0000","last_active":"2024-09-12T02:05:23.113089+0000","last_peered":"2024-09-12T02:05:23.113089+0000","last_clean":"2024-09-12T02:05:23.113089+0000","last_became_active":"2024-09-12T02:05:07.042057+0000","last_became_peered":"2024-09-12T02:05:07.042057+0000","last_unstale":"2024-09-12T02:05:23.113089+0000","last_undegraded":"2024-09-12T02:05:23.113089+0000","last_fullsized":"2024-09-12T02:05:23.113089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:35.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119527+0000","last_change":"2024-09-12T02:05:07.049334+0000","last_active":"2024-09-12T02:05:23.119527+0000","last_peered":"2024-09-12T02:05:23.119527+0000","last_clean":"2024-09-12T02:05:23.119527+0000","last_became_active":"2024-09-12T02:05:07.049025+0000","last_became_peered":"2024-09-12T02:05:07.049025+0000","last_unstale":"2024-09-12T02:05:23.119527+0000","last_undegraded":"2024-09-12T02:05:23.119527+0000","last_fullsized":"2024-09-12T02:05:23.119527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:20.075991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121156+0000","last_change":"2024-09-12T02:05:07.049145+0000","last_active":"2024-09-12T02:05:23.121156+0000","last_peered":"2024-09-12T02:05:23.121156+0000","last_clean":"2024-09-12T02:05:23.121156+0000","last_became_active":"2024-09-12T02:05:07.045669+0000","last_became_peered":"2024-09-12T02:05:07.045669+0000","last_unstale":"2024-09-12T02:05:23.121156+0000","last_undegraded":"2024-09-12T02:05:23.121156+0000","last_fullsized":"2024-09-12T02:05:23.121156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:56.359913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116526+0000","last_change":"2024-09-12T02:05:07.036256+0000","last_active":"2024-09-12T02:05:23.116526+0000","last_peered":"2024-09-12T02:05:23.116526+0000","last_clean":"2024-09-12T02:05:23.116526+0000","last_became_active":"2024-09-12T02:05:07.035916+0000","last_became_peered":"2024-09-12T02:05:07.035916+0000","last_unstale":"2024-09-12T02:05:23.116526+0000","last_undegraded":"2024-09-12T02:05:23.116526+0000","last_fullsized":"2024-09-12T02:05:23.116526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.910773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121572+0000","last_change":"2024-09-12T02:05:07.049557+0000","last_active":"2024-09-12T02:05:23.121572+0000","last_peered":"2024-09-12T02:05:23.121572+0000","last_clean":"2024-09-12T02:05:23.121572+0000","last_became_active":"2024-09-12T02:05:07.045551+0000","last_became_peered":"2024-09-12T02:05:07.045551+0000","last_unstale":"2024-09-12T02:05:23.121572+0000","last_undegraded":"2024-09-12T02:05:23.121572+0000","last_fullsized":"2024-09-12T02:05:23.121572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:25.934797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115422+0000","last_change":"2024-09-12T02:05:07.048708+0000","last_active":"2024-09-12T02:05:23.115422+0000","last_peered":"2024-09-12T02:05:23.115422+0000","last_clean":"2024-09-12T02:05:23.115422+0000","last_became_active":"2024-09-12T02:05:07.048381+0000","last_became_peered":"2024-09-12T02:05:07.048381+0000","last_unstale":"2024-09-12T02:05:23.115422+0000","last_undegraded":"2024-09-12T02:05:23.115422+0000","last_fullsized":"2024-09-12T02:05:23.115422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:08.196194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116737+0000","last_change":"2024-09-12T02:05:07.048819+0000","last_active":"2024-09-12T02:05:23.116737+0000","last_peered":"2024-09-12T02:05:23.116737+0000","last_clean":"2024-09-12T02:05:23.116737+0000","last_became_active":"2024-09-12T02:05:07.048498+0000","last_became_peered":"2024-09-12T02:05:07.048498+0000","last_unstale":"2024-09-12T02:05:23.116737+0000","last_undegraded":"2024-09-12T02:05:23.116737+0000","last_fullsized":"2024-09-12T02:05:23.116737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:14.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.118160+0000","last_change":"2024-09-12T02:05:23.118160+0000","last_active":"2024-09-12T02:05:23.118160+0000","last_peered":"2024-09-12T02:05:23.118160+0000","last_clean":"2024-09-12T02:05:23.118160+0000","last_became_active":"2024-09-12T02:05:23.117807+0000","last_became_peered":"2024-09-12T02:05:23.117807+0000","last_unstale":"2024-09-12T02:05:23.118160+0000","last_undegraded":"2024-09-12T02:05:23.118160+0000","last_fullsized":"2024-09-12T02:05:23.118160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:54.362153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116451+0000","last_change":"2024-09-12T02:05:07.047723+0000","last_active":"2024-09-12T02:05:23.116451+0000","last_peered":"2024-09-12T02:05:23.116451+0000","last_clean":"2024-09-12T02:05:23.116451+0000","last_became_active":"2024-09-12T02:05:07.044761+0000","last_became_peered":"2024-09-12T02:05:07.044761+0000","last_unstale":"2024-09-12T02:05:23.116451+0000","last_undegraded":"2024-09-12T02:05:23.116451+0000","last_fullsized":"2024-09-12T02:05:23.116451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:42.691226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114572+0000","last_change":"2024-09-12T02:05:07.042799+0000","last_active":"2024-09-12T02:05:23.114572+0000","last_peered":"2024-09-12T02:05:23.114572+0000","last_clean":"2024-09-12T02:05:23.114572+0000","last_became_active":"2024-09-12T02:05:07.042458+0000","last_became_peered":"2024-09-12T02:05:07.042458+0000","last_unstale":"2024-09-12T02:05:23.114572+0000","last_undegraded":"2024-09-12T02:05:23.114572+0000","last_fullsized":"2024-09-12T02:05:23.114572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:14.166084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.115015+0000","last_change":"2024-09-12T02:05:07.052315+0000","last_active":"2024-09-12T02:05:23.115015+0000","last_peered":"2024-09-12T02:05:23.115015+0000","last_clean":"2024-09-12T02:05:23.115015+0000","last_became_active":"2024-09-12T02:05:07.051908+0000","last_became_peered":"2024-09-12T02:05:07.051908+0000","last_unstale":"2024-09-12T02:05:23.115015+0000","last_undegraded":"2024-09-12T02:05:23.115015+0000","last_fullsized":"2024-09-12T02:05:23.115015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:03.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116423+0000","last_change":"2024-09-12T02:05:07.045645+0000","last_active":"2024-09-12T02:05:23.116423+0000","last_peered":"2024-09-12T02:05:23.116423+0000","last_clean":"2024-09-12T02:05:23.116423+0000","last_became_active":"2024-09-12T02:05:07.045345+0000","last_became_peered":"2024-09-12T02:05:07.045345+0000","last_unstale":"2024-09-12T02:05:23.116423+0000","last_undegraded":"2024-09-12T02:05:23.116423+0000","last_fullsized":"2024-09-12T02:05:23.116423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:52.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119809+0000","last_change":"2024-09-12T02:05:07.045121+0000","last_active":"2024-09-12T02:05:23.119809+0000","last_peered":"2024-09-12T02:05:23.119809+0000","last_clean":"2024-09-12T02:05:23.119809+0000","last_became_active":"2024-09-12T02:05:07.044709+0000","last_became_peered":"2024-09-12T02:05:07.044709+0000","last_unstale":"2024-09-12T02:05:23.119809+0000","last_undegraded":"2024-09-12T02:05:23.119809+0000","last_fullsized":"2024-09-12T02:05:23.119809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:16.763345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":131,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.905366+0000","last_change":"2024-09-12T02:05:05.033959+0000","last_active":"2024-09-12T02:06:52.905366+0000","last_peered":"2024-09-12T02:06:52.905366+0000","last_clean":"2024-09-12T02:06:52.905366+0000","last_became_active":"2024-09-12T02:05:05.032993+0000","last_became_peered":"2024-09-12T02:05:05.032993+0000","last_unstale":"2024-09-12T02:06:52.905366+0000","last_undegraded":"2024-09-12T02:06:52.905366+0000","last_fullsized":"2024-09-12T02:06:52.905366+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:28.924586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.122864+0000","last_change":"2024-09-12T02:05:23.122864+0000","last_active":"2024-09-12T02:05:23.122864+0000","last_peered":"2024-09-12T02:05:23.122864+0000","last_clean":"2024-09-12T02:05:23.122864+0000","last_became_active":"2024-09-12T02:05:23.122342+0000","last_became_peered":"2024-09-12T02:05:23.122342+0000","last_unstale":"2024-09-12T02:05:23.122864+0000","last_undegraded":"2024-09-12T02:05:23.122864+0000","last_fullsized":"2024-09-12T02:05:23.122864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335458+0000","last_change":"2024-09-12T02:05:05.031167+0000","last_active":"2024-09-12T02:05:23.335458+0000","last_peered":"2024-09-12T02:05:23.335458+0000","last_clean":"2024-09-12T02:05:23.335458+0000","last_became_active":"2024-09-12T02:05:05.030824+0000","last_became_peered":"2024-09-12T02:05:05.030824+0000","last_unstale":"2024-09-12T02:05:23.335458+0000","last_undegraded":"2024-09-12T02:05:23.335458+0000","last_fullsized":"2024-09-12T02:05:23.335458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:37.857643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112617+0000","last_change":"2024-09-12T02:05:05.030057+0000","last_active":"2024-09-12T02:05:23.112617+0000","last_peered":"2024-09-12T02:05:23.112617+0000","last_clean":"2024-09-12T02:05:23.112617+0000","last_became_active":"2024-09-12T02:05:05.029699+0000","last_became_peered":"2024-09-12T02:05:05.029699+0000","last_unstale":"2024-09-12T02:05:23.112617+0000","last_undegraded":"2024-09-12T02:05:23.112617+0000","last_fullsized":"2024-09-12T02:05:23.112617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:44.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121378+0000","last_change":"2024-09-12T02:05:07.049373+0000","last_active":"2024-09-12T02:05:23.121378+0000","last_peered":"2024-09-12T02:05:23.121378+0000","last_clean":"2024-09-12T02:05:23.121378+0000","last_became_active":"2024-09-12T02:05:07.045591+0000","last_became_peered":"2024-09-12T02:05:07.045591+0000","last_unstale":"2024-09-12T02:05:23.121378+0000","last_undegraded":"2024-09-12T02:05:23.121378+0000","last_fullsized":"2024-09-12T02:05:23.121378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:13.962583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117370+0000","last_change":"2024-09-12T02:05:05.031863+0000","last_active":"2024-09-12T02:05:23.117370+0000","last_peered":"2024-09-12T02:05:23.117370+0000","last_clean":"2024-09-12T02:05:23.117370+0000","last_became_active":"2024-09-12T02:05:05.031431+0000","last_became_peered":"2024-09-12T02:05:05.031431+0000","last_unstale":"2024-09-12T02:05:23.117370+0000","last_undegraded":"2024-09-12T02:05:23.117370+0000","last_fullsized":"2024-09-12T02:05:23.117370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:33.318214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116139+0000","last_change":"2024-09-12T02:05:07.043102+0000","last_active":"2024-09-12T02:05:23.116139+0000","last_peered":"2024-09-12T02:05:23.116139+0000","last_clean":"2024-09-12T02:05:23.116139+0000","last_became_active":"2024-09-12T02:05:07.042767+0000","last_became_peered":"2024-09-12T02:05:07.042767+0000","last_unstale":"2024-09-12T02:05:23.116139+0000","last_undegraded":"2024-09-12T02:05:23.116139+0000","last_fullsized":"2024-09-12T02:05:23.116139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:38.259023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:51.902803+0000","last_change":"2024-09-12T02:05:05.033281+0000","last_active":"2024-09-12T02:06:51.902803+0000","last_peered":"2024-09-12T02:06:51.902803+0000","last_clean":"2024-09-12T02:06:51.902803+0000","last_became_active":"2024-09-12T02:05:05.032895+0000","last_became_peered":"2024-09-12T02:05:05.032895+0000","last_unstale":"2024-09-12T02:06:51.902803+0000","last_undegraded":"2024-09-12T02:06:51.902803+0000","last_fullsized":"2024-09-12T02:06:51.902803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:38.563478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119515+0000","last_change":"2024-09-12T02:05:07.045654+0000","last_active":"2024-09-12T02:05:23.119515+0000","last_peered":"2024-09-12T02:05:23.119515+0000","last_clean":"2024-09-12T02:05:23.119515+0000","last_became_active":"2024-09-12T02:05:07.044007+0000","last_became_peered":"2024-09-12T02:05:07.044007+0000","last_unstale":"2024-09-12T02:05:23.119515+0000","last_undegraded":"2024-09-12T02:05:23.119515+0000","last_fullsized":"2024-09-12T02:05:23.119515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.903028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275207+0000","last_change":"2024-09-12T02:05:05.035050+0000","last_active":"2024-09-12T02:05:23.275207+0000","last_peered":"2024-09-12T02:05:23.275207+0000","last_clean":"2024-09-12T02:05:23.275207+0000","last_became_active":"2024-09-12T02:05:05.034401+0000","last_became_peered":"2024-09-12T02:05:05.034401+0000","last_unstale":"2024-09-12T02:05:23.275207+0000","last_undegraded":"2024-09-12T02:05:23.275207+0000","last_fullsized":"2024-09-12T02:05:23.275207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:20.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119588+0000","last_change":"2024-09-12T02:05:23.119588+0000","last_active":"2024-09-12T02:05:23.119588+0000","last_peered":"2024-09-12T02:05:23.119588+0000","last_clean":"2024-09-12T02:05:23.119588+0000","last_became_active":"2024-09-12T02:05:23.119250+0000","last_became_peered":"2024-09-12T02:05:23.119250+0000","last_unstale":"2024-09-12T02:05:23.119588+0000","last_undegraded":"2024-09-12T02:05:23.119588+0000","last_fullsized":"2024-09-12T02:05:23.119588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:11.230435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117367+0000","last_change":"2024-09-12T02:05:05.301861+0000","last_active":"2024-09-12T02:05:23.117367+0000","last_peered":"2024-09-12T02:05:23.117367+0000","last_clean":"2024-09-12T02:05:23.117367+0000","last_became_active":"2024-09-12T02:05:05.301433+0000","last_became_peered":"2024-09-12T02:05:05.301433+0000","last_unstale":"2024-09-12T02:05:23.117367+0000","last_undegraded":"2024-09-12T02:05:23.117367+0000","last_fullsized":"2024-09-12T02:05:23.117367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.468673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119177+0000","last_change":"2024-09-12T02:05:07.050105+0000","last_active":"2024-09-12T02:05:23.119177+0000","last_peered":"2024-09-12T02:05:23.119177+0000","last_clean":"2024-09-12T02:05:23.119177+0000","last_became_active":"2024-09-12T02:05:07.049337+0000","last_became_peered":"2024-09-12T02:05:07.049337+0000","last_unstale":"2024-09-12T02:05:23.119177+0000","last_undegraded":"2024-09-12T02:05:23.119177+0000","last_fullsized":"2024-09-12T02:05:23.119177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:29.073305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":258,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.904476+0000","last_change":"2024-09-12T02:05:05.032406+0000","last_active":"2024-09-12T02:06:52.904476+0000","last_peered":"2024-09-12T02:06:52.904476+0000","last_clean":"2024-09-12T02:06:52.904476+0000","last_became_active":"2024-09-12T02:05:05.031966+0000","last_became_peered":"2024-09-12T02:05:05.031966+0000","last_unstale":"2024-09-12T02:06:52.904476+0000","last_undegraded":"2024-09-12T02:06:52.904476+0000","last_fullsized":"2024-09-12T02:06:52.904476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:45.256363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66906,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":167,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120876+0000","last_change":"2024-09-12T02:05:07.050799+0000","last_active":"2024-09-12T02:05:23.120876+0000","last_peered":"2024-09-12T02:05:23.120876+0000","last_clean":"2024-09-12T02:05:23.120876+0000","last_became_active":"2024-09-12T02:05:07.050270+0000","last_became_peered":"2024-09-12T02:05:07.050270+0000","last_unstale":"2024-09-12T02:05:23.120876+0000","last_undegraded":"2024-09-12T02:05:23.120876+0000","last_fullsized":"2024-09-12T02:05:23.120876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:08.109772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114730+0000","last_change":"2024-09-12T02:05:05.031828+0000","last_active":"2024-09-12T02:05:23.114730+0000","last_peered":"2024-09-12T02:05:23.114730+0000","last_clean":"2024-09-12T02:05:23.114730+0000","last_became_active":"2024-09-12T02:05:05.031376+0000","last_became_peered":"2024-09-12T02:05:05.031376+0000","last_unstale":"2024-09-12T02:05:23.114730+0000","last_undegraded":"2024-09-12T02:05:23.114730+0000","last_fullsized":"2024-09-12T02:05:23.114730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.302583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112721+0000","last_change":"2024-09-12T02:05:07.048627+0000","last_active":"2024-09-12T02:05:23.112721+0000","last_peered":"2024-09-12T02:05:23.112721+0000","last_clean":"2024-09-12T02:05:23.112721+0000","last_became_active":"2024-09-12T02:05:07.048344+0000","last_became_peered":"2024-09-12T02:05:07.048344+0000","last_unstale":"2024-09-12T02:05:23.112721+0000","last_undegraded":"2024-09-12T02:05:23.112721+0000","last_fullsized":"2024-09-12T02:05:23.112721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:12.342723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116775+0000","last_change":"2024-09-12T02:05:05.031873+0000","last_active":"2024-09-12T02:05:23.116775+0000","last_peered":"2024-09-12T02:05:23.116775+0000","last_clean":"2024-09-12T02:05:23.116775+0000","last_became_active":"2024-09-12T02:05:05.031397+0000","last_became_peered":"2024-09-12T02:05:05.031397+0000","last_unstale":"2024-09-12T02:05:23.116775+0000","last_undegraded":"2024-09-12T02:05:23.116775+0000","last_fullsized":"2024-09-12T02:05:23.116775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:45.111961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.045395+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.045051+0000","last_became_peered":"2024-09-12T02:05:07.045051+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.079727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.907343+0000","last_change":"2024-09-12T02:05:05.031789+0000","last_active":"2024-09-12T02:06:54.907343+0000","last_peered":"2024-09-12T02:06:54.907343+0000","last_clean":"2024-09-12T02:06:54.907343+0000","last_became_active":"2024-09-12T02:05:05.031370+0000","last_became_peered":"2024-09-12T02:05:05.031370+0000","last_unstale":"2024-09-12T02:06:54.907343+0000","last_undegraded":"2024-09-12T02:06:54.907343+0000","last_fullsized":"2024-09-12T02:06:54.907343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:10.889660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.274841+0000","last_change":"2024-09-12T02:05:07.046098+0000","last_active":"2024-09-12T02:05:23.274841+0000","last_peered":"2024-09-12T02:05:23.274841+0000","last_clean":"2024-09-12T02:05:23.274841+0000","last_became_active":"2024-09-12T02:05:07.045490+0000","last_became_peered":"2024-09-12T02:05:07.045490+0000","last_unstale":"2024-09-12T02:05:23.274841+0000","last_undegraded":"2024-09-12T02:05:23.274841+0000","last_fullsized":"2024-09-12T02:05:23.274841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:37.236230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120297+0000","last_change":"2024-09-12T02:05:05.300573+0000","last_active":"2024-09-12T02:05:23.120297+0000","last_peered":"2024-09-12T02:05:23.120297+0000","last_clean":"2024-09-12T02:05:23.120297+0000","last_became_active":"2024-09-12T02:05:05.300161+0000","last_became_peered":"2024-09-12T02:05:05.300161+0000","last_unstale":"2024-09-12T02:05:23.120297+0000","last_undegraded":"2024-09-12T02:05:23.120297+0000","last_fullsized":"2024-09-12T02:05:23.120297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:47.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117566+0000","last_change":"2024-09-12T02:05:07.047556+0000","last_active":"2024-09-12T02:05:23.117566+0000","last_peered":"2024-09-12T02:05:23.117566+0000","last_clean":"2024-09-12T02:05:23.117566+0000","last_became_active":"2024-09-12T02:05:07.047260+0000","last_became_peered":"2024-09-12T02:05:07.047260+0000","last_unstale":"2024-09-12T02:05:23.117566+0000","last_undegraded":"2024-09-12T02:05:23.117566+0000","last_fullsized":"2024-09-12T02:05:23.117566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:23.199132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120988+0000","last_change":"2024-09-12T02:05:05.032743+0000","last_active":"2024-09-12T02:05:23.120988+0000","last_peered":"2024-09-12T02:05:23.120988+0000","last_clean":"2024-09-12T02:05:23.120988+0000","last_became_active":"2024-09-12T02:05:05.032402+0000","last_became_peered":"2024-09-12T02:05:05.032402+0000","last_unstale":"2024-09-12T02:05:23.120988+0000","last_undegraded":"2024-09-12T02:05:23.120988+0000","last_fullsized":"2024-09-12T02:05:23.120988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:16.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116269+0000","last_change":"2024-09-12T02:05:07.045878+0000","last_active":"2024-09-12T02:05:23.116269+0000","last_peered":"2024-09-12T02:05:23.116269+0000","last_clean":"2024-09-12T02:05:23.116269+0000","last_became_active":"2024-09-12T02:05:07.045569+0000","last_became_peered":"2024-09-12T02:05:07.045569+0000","last_unstale":"2024-09-12T02:05:23.116269+0000","last_undegraded":"2024-09-12T02:05:23.116269+0000","last_fullsized":"2024-09-12T02:05:23.116269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:45.478429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112746+0000","last_change":"2024-09-12T02:05:05.034146+0000","last_active":"2024-09-12T02:05:23.112746+0000","last_peered":"2024-09-12T02:05:23.112746+0000","last_clean":"2024-09-12T02:05:23.112746+0000","last_became_active":"2024-09-12T02:05:05.033788+0000","last_became_peered":"2024-09-12T02:05:05.033788+0000","last_unstale":"2024-09-12T02:05:23.112746+0000","last_undegraded":"2024-09-12T02:05:23.112746+0000","last_fullsized":"2024-09-12T02:05:23.112746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:18.386725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275258+0000","last_change":"2024-09-12T02:05:07.048253+0000","last_active":"2024-09-12T02:05:23.275258+0000","last_peered":"2024-09-12T02:05:23.275258+0000","last_clean":"2024-09-12T02:05:23.275258+0000","last_became_active":"2024-09-12T02:05:07.047896+0000","last_became_peered":"2024-09-12T02:05:07.047896+0000","last_unstale":"2024-09-12T02:05:23.275258+0000","last_undegraded":"2024-09-12T02:05:23.275258+0000","last_fullsized":"2024-09-12T02:05:23.275258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:27.256840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117446+0000","last_change":"2024-09-12T02:05:05.030900+0000","last_active":"2024-09-12T02:05:23.117446+0000","last_peered":"2024-09-12T02:05:23.117446+0000","last_clean":"2024-09-12T02:05:23.117446+0000","last_became_active":"2024-09-12T02:05:05.028787+0000","last_became_peered":"2024-09-12T02:05:05.028787+0000","last_unstale":"2024-09-12T02:05:23.117446+0000","last_undegraded":"2024-09-12T02:05:23.117446+0000","last_fullsized":"2024-09-12T02:05:23.117446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:34.053025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275129+0000","last_change":"2024-09-12T02:05:07.045066+0000","last_active":"2024-09-12T02:05:23.275129+0000","last_peered":"2024-09-12T02:05:23.275129+0000","last_clean":"2024-09-12T02:05:23.275129+0000","last_became_active":"2024-09-12T02:05:07.044697+0000","last_became_peered":"2024-09-12T02:05:07.044697+0000","last_unstale":"2024-09-12T02:05:23.275129+0000","last_undegraded":"2024-09-12T02:05:23.275129+0000","last_fullsized":"2024-09-12T02:05:23.275129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:41.853721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125649+0000","last_change":"2024-09-12T02:05:23.124660+0000","last_active":"2024-09-12T02:05:23.125649+0000","last_peered":"2024-09-12T02:05:23.125649+0000","last_clean":"2024-09-12T02:05:23.125649+0000","last_became_active":"2024-09-12T02:05:23.118056+0000","last_became_peered":"2024-09-12T02:05:23.118056+0000","last_unstale":"2024-09-12T02:05:23.125649+0000","last_undegraded":"2024-09-12T02:05:23.125649+0000","last_fullsized":"2024-09-12T02:05:23.125649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:51.424845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275159+0000","last_change":"2024-09-12T02:05:07.047400+0000","last_active":"2024-09-12T02:05:23.275159+0000","last_peered":"2024-09-12T02:05:23.275159+0000","last_clean":"2024-09-12T02:05:23.275159+0000","last_became_active":"2024-09-12T02:05:07.047094+0000","last_became_peered":"2024-09-12T02:05:07.047094+0000","last_unstale":"2024-09-12T02:05:23.275159+0000","last_undegraded":"2024-09-12T02:05:23.275159+0000","last_fullsized":"2024-09-12T02:05:23.275159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.777383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275237+0000","last_change":"2024-09-12T02:03:56.584896+0000","last_active":"2024-09-12T02:05:23.275237+0000","last_peered":"2024-09-12T02:05:23.275237+0000","last_clean":"2024-09-12T02:05:23.275237+0000","last_became_active":"2024-09-12T02:03:56.584479+0000","last_became_peered":"2024-09-12T02:03:56.584479+0000","last_unstale":"2024-09-12T02:05:23.275237+0000","last_undegraded":"2024-09-12T02:05:23.275237+0000","last_fullsized":"2024-09-12T02:05:23.275237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:00:34.984190+0000","last_clean_scrub_stamp":"2024-09-12T02:00:34.984190+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:02.370012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114008+0000","last_change":"2024-09-12T02:05:05.028381+0000","last_active":"2024-09-12T02:05:23.114008+0000","last_peered":"2024-09-12T02:05:23.114008+0000","last_clean":"2024-09-12T02:05:23.114008+0000","last_became_active":"2024-09-12T02:05:05.028059+0000","last_became_peered":"2024-09-12T02:05:05.028059+0000","last_unstale":"2024-09-12T02:05:23.114008+0000","last_undegraded":"2024-09-12T02:05:23.114008+0000","last_fullsized":"2024-09-12T02:05:23.114008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.513496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121622+0000","last_change":"2024-09-12T02:05:07.034756+0000","last_active":"2024-09-12T02:05:23.121622+0000","last_peered":"2024-09-12T02:05:23.121622+0000","last_clean":"2024-09-12T02:05:23.121622+0000","last_became_active":"2024-09-12T02:05:07.034461+0000","last_became_peered":"2024-09-12T02:05:07.034461+0000","last_unstale":"2024-09-12T02:05:23.121622+0000","last_undegraded":"2024-09-12T02:05:23.121622+0000","last_fullsized":"2024-09-12T02:05:23.121622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:52.543765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275070+0000","last_change":"2024-09-12T02:05:05.033049+0000","last_active":"2024-09-12T02:05:23.275070+0000","last_peered":"2024-09-12T02:05:23.275070+0000","last_clean":"2024-09-12T02:05:23.275070+0000","last_became_active":"2024-09-12T02:05:05.032583+0000","last_became_peered":"2024-09-12T02:05:05.032583+0000","last_unstale":"2024-09-12T02:05:23.275070+0000","last_undegraded":"2024-09-12T02:05:23.275070+0000","last_fullsized":"2024-09-12T02:05:23.275070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:00.623924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112609+0000","last_change":"2024-09-12T02:05:07.046612+0000","last_active":"2024-09-12T02:05:23.112609+0000","last_peered":"2024-09-12T02:05:23.112609+0000","last_clean":"2024-09-12T02:05:23.112609+0000","last_became_active":"2024-09-12T02:05:07.046312+0000","last_became_peered":"2024-09-12T02:05:07.046312+0000","last_unstale":"2024-09-12T02:05:23.112609+0000","last_undegraded":"2024-09-12T02:05:23.112609+0000","last_fullsized":"2024-09-12T02:05:23.112609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.903648+0000","last_change":"2024-09-12T02:05:05.301758+0000","last_active":"2024-09-12T02:06:52.903648+0000","last_peered":"2024-09-12T02:06:52.903648+0000","last_clean":"2024-09-12T02:06:52.903648+0000","last_became_active":"2024-09-12T02:05:05.301392+0000","last_became_peered":"2024-09-12T02:05:05.301392+0000","last_unstale":"2024-09-12T02:06:52.903648+0000","last_undegraded":"2024-09-12T02:06:52.903648+0000","last_fullsized":"2024-09-12T02:06:52.903648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:35.040312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.117201+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.117201+0000","last_peered":"2024-09-12T02:05:23.117201+0000","last_clean":"2024-09-12T02:05:23.117201+0000","last_became_active":"2024-09-12T02:05:07.049075+0000","last_became_peered":"2024-09-12T02:05:07.049075+0000","last_unstale":"2024-09-12T02:05:23.117201+0000","last_undegraded":"2024-09-12T02:05:23.117201+0000","last_fullsized":"2024-09-12T02:05:23.117201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275161+0000","last_change":"2024-09-12T02:05:05.030121+0000","last_active":"2024-09-12T02:05:23.275161+0000","last_peered":"2024-09-12T02:05:23.275161+0000","last_clean":"2024-09-12T02:05:23.275161+0000","last_became_active":"2024-09-12T02:05:05.029713+0000","last_became_peered":"2024-09-12T02:05:05.029713+0000","last_unstale":"2024-09-12T02:05:23.275161+0000","last_undegraded":"2024-09-12T02:05:23.275161+0000","last_fullsized":"2024-09-12T02:05:23.275161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:26.103616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335480+0000","last_change":"2024-09-12T02:05:07.047625+0000","last_active":"2024-09-12T02:05:23.335480+0000","last_peered":"2024-09-12T02:05:23.335480+0000","last_clean":"2024-09-12T02:05:23.335480+0000","last_became_active":"2024-09-12T02:05:07.047295+0000","last_became_peered":"2024-09-12T02:05:07.047295+0000","last_unstale":"2024-09-12T02:05:23.335480+0000","last_undegraded":"2024-09-12T02:05:23.335480+0000","last_fullsized":"2024-09-12T02:05:23.335480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.205967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116107+0000","last_change":"2024-09-12T02:05:05.300742+0000","last_active":"2024-09-12T02:05:23.116107+0000","last_peered":"2024-09-12T02:05:23.116107+0000","last_clean":"2024-09-12T02:05:23.116107+0000","last_became_active":"2024-09-12T02:05:05.300389+0000","last_became_peered":"2024-09-12T02:05:05.300389+0000","last_unstale":"2024-09-12T02:05:23.116107+0000","last_undegraded":"2024-09-12T02:05:23.116107+0000","last_fullsized":"2024-09-12T02:05:23.116107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:45.192599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.335510+0000","last_change":"2024-09-12T02:05:07.050331+0000","last_active":"2024-09-12T02:05:23.335510+0000","last_peered":"2024-09-12T02:05:23.335510+0000","last_clean":"2024-09-12T02:05:23.335510+0000","last_became_active":"2024-09-12T02:05:07.048911+0000","last_became_peered":"2024-09-12T02:05:07.048911+0000","last_unstale":"2024-09-12T02:05:23.335510+0000","last_undegraded":"2024-09-12T02:05:23.335510+0000","last_fullsized":"2024-09-12T02:05:23.335510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:05.723251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121090+0000","last_change":"2024-09-12T02:05:05.300726+0000","last_active":"2024-09-12T02:05:23.121090+0000","last_peered":"2024-09-12T02:05:23.121090+0000","last_clean":"2024-09-12T02:05:23.121090+0000","last_became_active":"2024-09-12T02:05:05.300309+0000","last_became_peered":"2024-09-12T02:05:05.300309+0000","last_unstale":"2024-09-12T02:05:23.121090+0000","last_undegraded":"2024-09-12T02:05:23.121090+0000","last_fullsized":"2024-09-12T02:05:23.121090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:01.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.112857+0000","last_change":"2024-09-12T02:05:07.039760+0000","last_active":"2024-09-12T02:05:23.112857+0000","last_peered":"2024-09-12T02:05:23.112857+0000","last_clean":"2024-09-12T02:05:23.112857+0000","last_became_active":"2024-09-12T02:05:07.039242+0000","last_became_peered":"2024-09-12T02:05:07.039242+0000","last_unstale":"2024-09-12T02:05:23.112857+0000","last_undegraded":"2024-09-12T02:05:23.112857+0000","last_fullsized":"2024-09-12T02:05:23.112857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.318252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:31.050323+0000","last_change":"2024-09-12T02:05:05.027121+0000","last_active":"2024-09-12T02:05:31.050323+0000","last_peered":"2024-09-12T02:05:31.050323+0000","last_clean":"2024-09-12T02:05:31.050323+0000","last_became_active":"2024-09-12T02:05:05.026792+0000","last_became_peered":"2024-09-12T02:05:05.026792+0000","last_unstale":"2024-09-12T02:05:31.050323+0000","last_undegraded":"2024-09-12T02:05:31.050323+0000","last_fullsized":"2024-09-12T02:05:31.050323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:48.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121663+0000","last_change":"2024-09-12T02:05:07.049399+0000","last_active":"2024-09-12T02:05:23.121663+0000","last_peered":"2024-09-12T02:05:23.121663+0000","last_clean":"2024-09-12T02:05:23.121663+0000","last_became_active":"2024-09-12T02:05:07.046668+0000","last_became_peered":"2024-09-12T02:05:07.046668+0000","last_unstale":"2024-09-12T02:05:23.121663+0000","last_undegraded":"2024-09-12T02:05:23.121663+0000","last_fullsized":"2024-09-12T02:05:23.121663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.114419+0000","last_change":"2024-09-12T02:05:05.589802+0000","last_active":"2024-09-12T02:05:23.114419+0000","last_peered":"2024-09-12T02:05:23.114419+0000","last_clean":"2024-09-12T02:05:23.114419+0000","last_became_active":"2024-09-12T02:05:05.589511+0000","last_became_peered":"2024-09-12T02:05:05.589511+0000","last_unstale":"2024-09-12T02:05:23.114419+0000","last_undegraded":"2024-09-12T02:05:23.114419+0000","last_fullsized":"2024-09-12T02:05:23.114419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:59.872098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116630+0000","last_change":"2024-09-12T02:05:07.047542+0000","last_active":"2024-09-12T02:05:23.116630+0000","last_peered":"2024-09-12T02:05:23.116630+0000","last_clean":"2024-09-12T02:05:23.116630+0000","last_became_active":"2024-09-12T02:05:07.047132+0000","last_became_peered":"2024-09-12T02:05:07.047132+0000","last_unstale":"2024-09-12T02:05:23.116630+0000","last_undegraded":"2024-09-12T02:05:23.116630+0000","last_fullsized":"2024-09-12T02:05:23.116630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.819803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119068+0000","last_change":"2024-09-12T02:05:05.301913+0000","last_active":"2024-09-12T02:05:23.119068+0000","last_peered":"2024-09-12T02:05:23.119068+0000","last_clean":"2024-09-12T02:05:23.119068+0000","last_became_active":"2024-09-12T02:05:05.301547+0000","last_became_peered":"2024-09-12T02:05:05.301547+0000","last_unstale":"2024-09-12T02:05:23.119068+0000","last_undegraded":"2024-09-12T02:05:23.119068+0000","last_fullsized":"2024-09-12T02:05:23.119068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:57.775456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119689+0000","last_change":"2024-09-12T02:05:07.046769+0000","last_active":"2024-09-12T02:05:23.119689+0000","last_peered":"2024-09-12T02:05:23.119689+0000","last_clean":"2024-09-12T02:05:23.119689+0000","last_became_active":"2024-09-12T02:05:07.046460+0000","last_became_peered":"2024-09-12T02:05:07.046460+0000","last_unstale":"2024-09-12T02:05:23.119689+0000","last_undegraded":"2024-09-12T02:05:23.119689+0000","last_fullsized":"2024-09-12T02:05:23.119689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:56.200977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121331+0000","last_change":"2024-09-12T02:05:05.030997+0000","last_active":"2024-09-12T02:05:23.121331+0000","last_peered":"2024-09-12T02:05:23.121331+0000","last_clean":"2024-09-12T02:05:23.121331+0000","last_became_active":"2024-09-12T02:05:05.030629+0000","last_became_peered":"2024-09-12T02:05:05.030629+0000","last_unstale":"2024-09-12T02:05:23.121331+0000","last_undegraded":"2024-09-12T02:05:23.121331+0000","last_fullsized":"2024-09-12T02:05:23.121331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:12.925801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116525+0000","last_change":"2024-09-12T02:05:07.049271+0000","last_active":"2024-09-12T02:05:23.116525+0000","last_peered":"2024-09-12T02:05:23.116525+0000","last_clean":"2024-09-12T02:05:23.116525+0000","last_became_active":"2024-09-12T02:05:07.048952+0000","last_became_peered":"2024-09-12T02:05:07.048952+0000","last_unstale":"2024-09-12T02:05:23.116525+0000","last_undegraded":"2024-09-12T02:05:23.116525+0000","last_fullsized":"2024-09-12T02:05:23.116525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:47.144306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.116599+0000","last_change":"2024-09-12T02:05:23.127067+0000","last_active":"2024-09-12T02:05:24.116599+0000","last_peered":"2024-09-12T02:05:24.116599+0000","last_clean":"2024-09-12T02:05:24.116599+0000","last_became_active":"2024-09-12T02:05:23.122505+0000","last_became_peered":"2024-09-12T02:05:23.122505+0000","last_unstale":"2024-09-12T02:05:24.116599+0000","last_undegraded":"2024-09-12T02:05:24.116599+0000","last_fullsized":"2024-09-12T02:05:24.116599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.153831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121266+0000","last_change":"2024-09-12T02:05:07.046722+0000","last_active":"2024-09-12T02:05:23.121266+0000","last_peered":"2024-09-12T02:05:23.121266+0000","last_clean":"2024-09-12T02:05:23.121266+0000","last_became_active":"2024-09-12T02:05:07.046074+0000","last_became_peered":"2024-09-12T02:05:07.046074+0000","last_unstale":"2024-09-12T02:05:23.121266+0000","last_undegraded":"2024-09-12T02:05:23.121266+0000","last_fullsized":"2024-09-12T02:05:23.121266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:10.388220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120609+0000","last_change":"2024-09-12T02:05:05.033594+0000","last_active":"2024-09-12T02:05:23.120609+0000","last_peered":"2024-09-12T02:05:23.120609+0000","last_clean":"2024-09-12T02:05:23.120609+0000","last_became_active":"2024-09-12T02:05:05.032913+0000","last_became_peered":"2024-09-12T02:05:05.032913+0000","last_unstale":"2024-09-12T02:05:23.120609+0000","last_undegraded":"2024-09-12T02:05:23.120609+0000","last_fullsized":"2024-09-12T02:05:23.120609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:18.113266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.275037+0000","last_change":"2024-09-12T02:05:07.053598+0000","last_active":"2024-09-12T02:05:23.275037+0000","last_peered":"2024-09-12T02:05:23.275037+0000","last_clean":"2024-09-12T02:05:23.275037+0000","last_became_active":"2024-09-12T02:05:07.053297+0000","last_became_peered":"2024-09-12T02:05:07.053297+0000","last_unstale":"2024-09-12T02:05:23.275037+0000","last_undegraded":"2024-09-12T02:05:23.275037+0000","last_fullsized":"2024-09-12T02:05:23.275037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:38.118299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120958+0000","last_change":"2024-09-12T02:05:23.120564+0000","last_active":"2024-09-12T02:05:23.120958+0000","last_peered":"2024-09-12T02:05:23.120958+0000","last_clean":"2024-09-12T02:05:23.120958+0000","last_became_active":"2024-09-12T02:05:23.120220+0000","last_became_peered":"2024-09-12T02:05:23.120220+0000","last_unstale":"2024-09-12T02:05:23.120958+0000","last_undegraded":"2024-09-12T02:05:23.120958+0000","last_fullsized":"2024-09-12T02:05:23.120958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.974539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.125162+0000","last_change":"2024-09-12T02:05:23.124645+0000","last_active":"2024-09-12T02:05:23.125162+0000","last_peered":"2024-09-12T02:05:23.125162+0000","last_clean":"2024-09-12T02:05:23.125162+0000","last_became_active":"2024-09-12T02:05:23.120342+0000","last_became_peered":"2024-09-12T02:05:23.120342+0000","last_unstale":"2024-09-12T02:05:23.125162+0000","last_undegraded":"2024-09-12T02:05:23.125162+0000","last_fullsized":"2024-09-12T02:05:23.125162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:17.434630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.119053+0000","last_change":"2024-09-12T02:05:07.044160+0000","last_active":"2024-09-12T02:05:23.119053+0000","last_peered":"2024-09-12T02:05:23.119053+0000","last_clean":"2024-09-12T02:05:23.119053+0000","last_became_active":"2024-09-12T02:05:07.043820+0000","last_became_peered":"2024-09-12T02:05:07.043820+0000","last_unstale":"2024-09-12T02:05:23.119053+0000","last_undegraded":"2024-09-12T02:05:23.119053+0000","last_fullsized":"2024-09-12T02:05:23.119053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:53.161893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120980+0000","last_change":"2024-09-12T02:05:05.031387+0000","last_active":"2024-09-12T02:05:23.120980+0000","last_peered":"2024-09-12T02:05:23.120980+0000","last_clean":"2024-09-12T02:05:23.120980+0000","last_became_active":"2024-09-12T02:05:05.031043+0000","last_became_peered":"2024-09-12T02:05:05.031043+0000","last_unstale":"2024-09-12T02:05:23.120980+0000","last_undegraded":"2024-09-12T02:05:23.120980+0000","last_fullsized":"2024-09-12T02:05:23.120980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.929127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116664+0000","last_change":"2024-09-12T02:05:07.049084+0000","last_active":"2024-09-12T02:05:23.116664+0000","last_peered":"2024-09-12T02:05:23.116664+0000","last_clean":"2024-09-12T02:05:23.116664+0000","last_became_active":"2024-09-12T02:05:07.048755+0000","last_became_peered":"2024-09-12T02:05:07.048755+0000","last_unstale":"2024-09-12T02:05:23.116664+0000","last_undegraded":"2024-09-12T02:05:23.116664+0000","last_fullsized":"2024-09-12T02:05:23.116664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.121894+0000","last_change":"2024-09-12T02:05:05.300684+0000","last_active":"2024-09-12T02:05:23.121894+0000","last_peered":"2024-09-12T02:05:23.121894+0000","last_clean":"2024-09-12T02:05:23.121894+0000","last_became_active":"2024-09-12T02:05:05.300370+0000","last_became_peered":"2024-09-12T02:05:05.300370+0000","last_unstale":"2024-09-12T02:05:23.121894+0000","last_undegraded":"2024-09-12T02:05:23.121894+0000","last_fullsized":"2024-09-12T02:05:23.121894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:05.401927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.120052+0000","last_change":"2024-09-12T02:05:23.119475+0000","last_active":"2024-09-12T02:05:23.120052+0000","last_peered":"2024-09-12T02:05:23.120052+0000","last_clean":"2024-09-12T02:05:23.120052+0000","last_became_active":"2024-09-12T02:05:23.119145+0000","last_became_peered":"2024-09-12T02:05:23.119145+0000","last_unstale":"2024-09-12T02:05:23.120052+0000","last_undegraded":"2024-09-12T02:05:23.120052+0000","last_fullsized":"2024-09-12T02:05:23.120052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:06.019575+0000","last_clean_scrub_stamp":"2024-09-12T02:05:06.019575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:51.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.116837+0000","last_change":"2024-09-12T02:05:05.029770+0000","last_active":"2024-09-12T02:05:23.116837+0000","last_peered":"2024-09-12T02:05:23.116837+0000","last_clean":"2024-09-12T02:05:23.116837+0000","last_became_active":"2024-09-12T02:05:05.029407+0000","last_became_peered":"2024-09-12T02:05:05.029407+0000","last_unstale":"2024-09-12T02:05:23.116837+0000","last_undegraded":"2024-09-12T02:05:23.116837+0000","last_fullsized":"2024-09-12T02:05:23.116837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:05:04.005542+0000","last_clean_scrub_stamp":"2024-09-12T02:05:04.005542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:35.007439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71217,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":618,"num_read_kb":382,"num_write":169,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":438009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716568,"statfs":{"total":95995035648,"available":95965765632,"internally_reserved":0,"allocated":1597440,"data_stored":1096396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":438245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234034,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1030405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":437634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1030089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":438653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":437945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":505802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":504333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:00.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:07:00.624 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:01.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.083+0000 7fe539baf640 1 -- 172.21.15.100:0/1113408190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 msgr2=0x7fe534106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:01.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.083+0000 7fe539baf640 1 --2- 172.21.15.100:0/1113408190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe534106e60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe524009930 tx=0x7fe52402a420 comp rx=0 tx=0).stop 2024-09-12T02:07:01.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 -- 172.21.15.100:0/1113408190 shutdown_connections 2024-09-12T02:07:01.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 --2- 172.21.15.100:0/1113408190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe534101420 0x7fe53410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 --2- 172.21.15.100:0/1113408190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe534100a80 0x7fe534100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 --2- 172.21.15.100:0/1113408190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe534106e60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 -- 172.21.15.100:0/1113408190 >> 172.21.15.100:0/1113408190 conn(0x7fe5340fc7a0 msgr2=0x7fe5340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 -- 172.21.15.100:0/1113408190 shutdown_connections 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 -- 172.21.15.100:0/1113408190 wait complete. 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 Processor -- start 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.084+0000 7fe539baf640 1 -- start start 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe539baf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe534100a80 0x7fe5341972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe539baf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe534101420 0x7fe534197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe539baf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe53419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe539baf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe534110e80 con 0x7fe534106a80 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe539baf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe534110d00 con 0x7fe534100a80 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe539baf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe534111000 con 0x7fe534101420 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe53419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe53419bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36572/0 (socket says 172.21.15.100:36572) 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 -- 172.21.15.100:0/2232614832 learned_addr learned my addr 172.21.15.100:0/2232614832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe5337fe640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe534100a80 0x7fe5341972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe52bfff640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe534101420 0x7fe534197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 -- 172.21.15.100:0/2232614832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe534101420 msgr2=0x7fe534197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe534101420 0x7fe534197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 -- 172.21.15.100:0/2232614832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe534100a80 msgr2=0x7fe5341972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe534100a80 0x7fe5341972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 -- 172.21.15.100:0/2232614832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53419c270 con 0x7fe534106a80 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe533fff640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe53419bb90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00cce0 tx=0x7fe52c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe5317fa640 1 -- 172.21.15.100:0/2232614832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00f450 con 0x7fe534106a80 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53419c560 con 0x7fe534106a80 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe5317fa640 1 -- 172.21.15.100:0/2232614832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe52c00fad0 con 0x7fe534106a80 2024-09-12T02:07:01.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.085+0000 7fe5317fa640 1 -- 172.21.15.100:0/2232614832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c018c10 con 0x7fe534106a80 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.086+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5341a3e40 con 0x7fe534106a80 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.087+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe534100ee0 con 0x7fe534106a80 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.087+0000 7fe5317fa640 1 -- 172.21.15.100:0/2232614832 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe52c00f5f0 con 0x7fe534106a80 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.088+0000 7fe5317fa640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe5200a2c10 0x7fe5200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.088+0000 7fe5337fe640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe5200a2c10 0x7fe5200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.088+0000 7fe5317fa640 1 -- 172.21.15.100:0/2232614832 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe52c0cf840 con 0x7fe534106a80 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.089+0000 7fe5337fe640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe5200a2c10 0x7fe5200a50d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe524009900 tx=0x7fe5240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.092+0000 7fe5317fa640 1 -- 172.21.15.100:0/2232614832 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe52c014030 con 0x7fe534106a80 2024-09-12T02:07:01.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.293+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe534108ff0 con 0x7fe534106a80 2024-09-12T02:07:01.293 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:01 smithi100 ceph-mon[31179]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:07:01.293 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:01 smithi100 ceph-mon[31179]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:07:01.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.293+0000 7fe5317fa640 1 -- 172.21.15.100:0/2232614832 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7fe52c09c650 con 0x7fe534106a80 2024-09-12T02:07:01.294 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:07:01.294 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:07:01.294 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.295+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe5200a2c10 msgr2=0x7fe5200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.295+0000 7fe539baf640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe5200a2c10 0x7fe5200a50d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe524009900 tx=0x7fe5240058d0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.295+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 msgr2=0x7fe53419bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.295+0000 7fe539baf640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe53419bb90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00cce0 tx=0x7fe52c00a620 comp rx=0 tx=0).stop 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 shutdown_connections 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe5200a2c10 0x7fe5200a50d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe534106a80 0x7fe53419bb90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe534101420 0x7fe534197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 --2- 172.21.15.100:0/2232614832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe534100a80 0x7fe5341972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 >> 172.21.15.100:0/2232614832 conn(0x7fe5340fc7a0 msgr2=0x7fe5340fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 shutdown_connections 2024-09-12T02:07:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:01.296+0000 7fe539baf640 1 -- 172.21.15.100:0/2232614832 wait complete. 2024-09-12T02:07:01.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:01 smithi189 ceph-mon[35188]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:07:01.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:01 smithi189 ceph-mon[35188]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:07:01.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:01 smithi117 ceph-mon[35240]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:07:01.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:01 smithi117 ceph-mon[35240]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:07:02.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:07:02.310 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:02.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:02 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2232614832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:02.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:02 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2232614832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:02.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:02 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2232614832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:02.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 -- 172.21.15.100:0/880047521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810100a80 msgr2=0x7fa810100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 --2- 172.21.15.100:0/880047521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810100a80 0x7fa810100ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa804009930 tx=0x7fa80402a420 comp rx=0 tx=0).stop 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 -- 172.21.15.100:0/880047521 shutdown_connections 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 --2- 172.21.15.100:0/880047521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa810101420 0x7fa81010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 --2- 172.21.15.100:0/880047521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810100a80 0x7fa810100ee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 --2- 172.21.15.100:0/880047521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa810106a80 0x7fa810106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 -- 172.21.15.100:0/880047521 >> 172.21.15.100:0/880047521 conn(0x7fa8100fc7a0 msgr2=0x7fa8100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 -- 172.21.15.100:0/880047521 shutdown_connections 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.765+0000 7fa815e6c640 1 -- 172.21.15.100:0/880047521 wait complete. 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 Processor -- start 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 -- start start 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa810100a80 0x7fa8100fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810101420 0x7fa8100fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa810106a80 0x7fa8100fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa810110e40 con 0x7fa810101420 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa810110cc0 con 0x7fa810100a80 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa815e6c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa810110fc0 con 0x7fa810106a80 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa80effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810101420 0x7fa8100fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa80effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810101420 0x7fa8100fd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36594/0 (socket says 172.21.15.100:36594) 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa80effd640 1 -- 172.21.15.100:0/3928340478 learned_addr learned my addr 172.21.15.100:0/3928340478 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa80ffff640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa810106a80 0x7fa8100fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.766+0000 7fa80f7fe640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa810100a80 0x7fa8100fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80effd640 1 -- 172.21.15.100:0/3928340478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa810106a80 msgr2=0x7fa8100fd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80effd640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa810106a80 0x7fa8100fd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80effd640 1 -- 172.21.15.100:0/3928340478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa810100a80 msgr2=0x7fa8100fcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80effd640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa810100a80 0x7fa8100fcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80effd640 1 -- 172.21.15.100:0/3928340478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8101a68f0 con 0x7fa810101420 2024-09-12T02:07:02.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80f7fe640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa810100a80 0x7fa8100fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80effd640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810101420 0x7fa8100fd290 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa804009230 tx=0x7fa804004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80cff9640 1 -- 172.21.15.100:0/3928340478 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80403f030 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8101a6b80 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80cff9640 1 -- 172.21.15.100:0/3928340478 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa804003ad0 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa80cff9640 1 -- 172.21.15.100:0/3928340478 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804035070 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.767+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8101a7060 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.768+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa810100ee0 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.769+0000 7fa80cff9640 1 -- 172.21.15.100:0/3928340478 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa804042030 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.770+0000 7fa80cff9640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa7f80a2c10 0x7fa7f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.770+0000 7fa80f7fe640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa7f80a2c10 0x7fa7f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.770+0000 7fa80cff9640 1 -- 172.21.15.100:0/3928340478 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa8040ef6c0 con 0x7fa810101420 2024-09-12T02:07:02.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.770+0000 7fa80f7fe640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa7f80a2c10 0x7fa7f80a50d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa800007350 tx=0x7fa8000072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:02.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.774+0000 7fa80cff9640 1 -- 172.21.15.100:0/3928340478 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8040bc4d0 con 0x7fa810101420 2024-09-12T02:07:02.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.975+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa81010a050 con 0x7fa810101420 2024-09-12T02:07:02.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.976+0000 7fa80cff9640 1 -- 172.21.15.100:0/3928340478 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7fa8040bbdd0 con 0x7fa810101420 2024-09-12T02:07:02.976 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:07:02.976 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:07:02.976 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa7f80a2c10 msgr2=0x7fa7f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa7f80a2c10 0x7fa7f80a50d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa800007350 tx=0x7fa8000072e0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810101420 msgr2=0x7fa8100fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810101420 0x7fa8100fd290 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa804009230 tx=0x7fa804004270 comp rx=0 tx=0).stop 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 shutdown_connections 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa7f80a2c10 0x7fa7f80a50d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa810106a80 0x7fa8100fd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa810101420 0x7fa8100fd290 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 --2- 172.21.15.100:0/3928340478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa810100a80 0x7fa8100fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 >> 172.21.15.100:0/3928340478 conn(0x7fa8100fc7a0 msgr2=0x7fa81006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 shutdown_connections 2024-09-12T02:07:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:02.978+0000 7fa815e6c640 1 -- 172.21.15.100:0/3928340478 wait complete. 2024-09-12T02:07:03.315 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:03 smithi100 ceph-mon[31179]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:07:03.315 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:03 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3928340478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:03 smithi117 ceph-mon[35240]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:07:03.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:03 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3928340478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:03 smithi189 ceph-mon[35188]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:07:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:03 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3928340478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:03.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:07:03.862 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:04.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3963119127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 msgr2=0x7fe2b4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3963119127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b4106e60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009930 tx=0x7fe2a402a420 comp rx=0 tx=0).stop 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3963119127 shutdown_connections 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3963119127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4101420 0x7fe2b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3963119127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b4100a80 0x7fe2b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3963119127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b4106e60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3963119127 >> 172.21.15.100:0/3963119127 conn(0x7fe2b40fc7a0 msgr2=0x7fe2b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3963119127 shutdown_connections 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3963119127 wait complete. 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 Processor -- start 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.331+0000 7fe2ba9c4640 1 -- start start 2024-09-12T02:07:04.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2ba9c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4100a80 0x7fe2b4199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2ba9c4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b4101420 0x7fe2b4199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2ba9c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b41a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2ba9c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4110f20 con 0x7fe2b4106a80 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2ba9c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4110da0 con 0x7fe2b4100a80 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2ba9c4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41110a0 con 0x7fe2b4101420 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b41a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b41a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40820/0 (socket says 172.21.15.100:40820) 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 -- 172.21.15.100:0/3360589770 learned_addr learned my addr 172.21.15.100:0/3360589770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b3fff640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4100a80 0x7fe2b4199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2abfff640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b4101420 0x7fe2b4199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 -- 172.21.15.100:0/3360589770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b4101420 msgr2=0x7fe2b4199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b4101420 0x7fe2b4199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 -- 172.21.15.100:0/3360589770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4100a80 msgr2=0x7fe2b4199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4100a80 0x7fe2b4199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 -- 172.21.15.100:0/3360589770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b41a49f0 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b3fff640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4100a80 0x7fe2b4199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b8f61640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b41a44b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00b970 tx=0x7fe2ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b1ffb640 1 -- 172.21.15.100:0/3360589770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac019070 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b1ffb640 1 -- 172.21.15.100:0/3360589770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2ac00cb40 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b41a4bc0 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.332+0000 7fe2b1ffb640 1 -- 172.21.15.100:0/3360589770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac007650 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.333+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b41a5080 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.333+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b4100f60 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.335+0000 7fe2b1ffb640 1 -- 172.21.15.100:0/3360589770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe2ac01c070 con 0x7fe2b4106a80 2024-09-12T02:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.335+0000 7fe2b1ffb640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe2a00a2c10 0x7fe2a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.336+0000 7fe2b3fff640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe2a00a2c10 0x7fe2a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.336+0000 7fe2b1ffb640 1 -- 172.21.15.100:0/3360589770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe2ac0cebc0 con 0x7fe2b4106a80 2024-09-12T02:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.336+0000 7fe2b3fff640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe2a00a2c10 0x7fe2a00a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000c00 tx=0x7fe2a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.339+0000 7fe2b1ffb640 1 -- 172.21.15.100:0/3360589770 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe2ac09bae0 con 0x7fe2b4106a80 2024-09-12T02:07:04.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.517+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2b402d7c0 con 0x7fe2b4106a80 2024-09-12T02:07:04.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.518+0000 7fe2b1ffb640 1 -- 172.21.15.100:0/3360589770 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7fe2ac09b3e0 con 0x7fe2b4106a80 2024-09-12T02:07:04.519 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:07:04.519 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe2a00a2c10 msgr2=0x7fe2a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe2a00a2c10 0x7fe2a00a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000c00 tx=0x7fe2a4005a20 comp rx=0 tx=0).stop 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 msgr2=0x7fe2b41a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b41a44b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00b970 tx=0x7fe2ac00be30 comp rx=0 tx=0).stop 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 shutdown_connections 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe2a00a2c10 0x7fe2a00a50d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b4106a80 0x7fe2b41a44b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b4101420 0x7fe2b4199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 --2- 172.21.15.100:0/3360589770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b4100a80 0x7fe2b4199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:04.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 >> 172.21.15.100:0/3360589770 conn(0x7fe2b40fc7a0 msgr2=0x7fe2b40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:04.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 shutdown_connections 2024-09-12T02:07:04.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:04.521+0000 7fe2ba9c4640 1 -- 172.21.15.100:0/3360589770 wait complete. 2024-09-12T02:07:05.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T02:07:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:05 smithi117 ceph-mon[35240]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T02:07:05.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:05 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3360589770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:07:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:05.551 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:05 smithi100 ceph-mon[31179]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T02:07:05.551 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:05 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3360589770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:07:05.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:05 smithi189 ceph-mon[35188]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T02:07:05.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:05 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3360589770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:07:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 -- 172.21.15.100:0/1146589851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 msgr2=0x7f67741072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 --2- 172.21.15.100:0/1146589851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f67741072f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6768009900 tx=0x7f676802a410 comp rx=0 tx=0).stop 2024-09-12T02:07:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 -- 172.21.15.100:0/1146589851 shutdown_connections 2024-09-12T02:07:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 --2- 172.21.15.100:0/1146589851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6774107830 0x7f6774109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 --2- 172.21.15.100:0/1146589851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f67741072f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 --2- 172.21.15.100:0/1146589851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67741025d0 0x7f67741049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 -- 172.21.15.100:0/1146589851 >> 172.21.15.100:0/1146589851 conn(0x7f67740fc1b0 msgr2=0x7f67740fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 -- 172.21.15.100:0/1146589851 shutdown_connections 2024-09-12T02:07:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.621+0000 7f677b81e640 1 -- 172.21.15.100:0/1146589851 wait complete. 2024-09-12T02:07:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 Processor -- start 2024-09-12T02:07:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 -- start start 2024-09-12T02:07:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67741025d0 0x7f6774101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f6774100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6774107830 0x7f6774100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f677410d8b0 con 0x7f6774104f00 2024-09-12T02:07:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f677410d730 con 0x7f67741025d0 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f677b81e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f677410da30 con 0x7f6774107830 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f6778db9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f6774100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f6778db9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f6774100580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40848/0 (socket says 172.21.15.100:40848) 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f6778db9640 1 -- 172.21.15.100:0/599576363 learned_addr learned my addr 172.21.15.100:0/599576363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.622+0000 7f67795ba640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67741025d0 0x7f6774101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f6779dbb640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6774107830 0x7f6774100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f6778db9640 1 -- 172.21.15.100:0/599576363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6774107830 msgr2=0x7f6774100ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f6778db9640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6774107830 0x7f6774100ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f6778db9640 1 -- 172.21.15.100:0/599576363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67741025d0 msgr2=0x7f6774101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f6778db9640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67741025d0 0x7f6774101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f6778db9640 1 -- 172.21.15.100:0/599576363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6774101350 con 0x7f6774104f00 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f67795ba640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67741025d0 0x7f6774101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f6778db9640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f6774100580 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6768031440 tx=0x7f6768032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f67667fc640 1 -- 172.21.15.100:0/599576363 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676803f030 con 0x7f6774104f00 2024-09-12T02:07:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f67667fc640 1 -- 172.21.15.100:0/599576363 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6768003ce0 con 0x7f6774104f00 2024-09-12T02:07:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f67667fc640 1 -- 172.21.15.100:0/599576363 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768035070 con 0x7f6774104f00 2024-09-12T02:07:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67741a1fa0 con 0x7f6774104f00 2024-09-12T02:07:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.623+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67741a2480 con 0x7f6774104f00 2024-09-12T02:07:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67667fc640 1 -- 172.21.15.100:0/599576363 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6768042030 con 0x7f6774104f00 2024-09-12T02:07:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 Processor -- start 2024-09-12T02:07:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 -- start start 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb31eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb323da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb326830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb2822f0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb22a270 con 0x55cfbb31e9a0 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f677e68f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb27e2b0 con 0x55cfbb324370 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb323da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb323da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40852/0 (socket says 172.21.15.100:40852) 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 -- 172.21.15.100:0/865202831 learned_addr learned my addr 172.21.15.100:0/865202831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f6779dbb640 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb31eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f6778db9640 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb326830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67667fc640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f67600a2cd0 0x7f67600a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 -- 172.21.15.100:0/865202831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 msgr2=0x55cfbb326830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb326830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 -- 172.21.15.100:0/865202831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 msgr2=0x55cfbb31eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb31eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.626+0000 7f67795ba640 1 -- 172.21.15.100:0/865202831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbb229340 con 0x55cfbb31f2e0 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.627+0000 7f6779dbb640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f67600a2cd0 0x7f67600a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.627+0000 7f67667fc640 1 -- 172.21.15.100:0/599576363 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f67680ef840 con 0x7f6774104f00 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.627+0000 7f67795ba640 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb323da0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6770007850 tx=0x7f6770007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8b0a54647e01c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.627+0000 7f675f7fe640 1 -- 172.21.15.100:0/865202831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677000d950 con 0x55cfbb31f2e0 2024-09-12T02:07:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.627+0000 7f675f7fe640 1 -- 172.21.15.100:0/865202831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6770018070 con 0x55cfbb31f2e0 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.627+0000 7f6779dbb640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f67600a2cd0 0x7f67600a5190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f677406b1a0 tx=0x7f676c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.627+0000 7f675f7fe640 1 -- 172.21.15.100:0/865202831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67700123e0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 -- 172.21.15.100:0/865202831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 msgr2=0x55cfbb323da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb323da0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6770007850 tx=0x7f6770007d10 comp rx=0 tx=0).stop 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 -- 172.21.15.100:0/865202831 shutdown_connections 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb326830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb323da0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 --2- 172.21.15.100:0/865202831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb31eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 -- 172.21.15.100:0/865202831 >> 172.21.15.100:0/865202831 conn(0x55cfbb31a010 msgr2=0x55cfbb31a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 -- 172.21.15.100:0/865202831 shutdown_connections 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 -- 172.21.15.100:0/865202831 wait complete. 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 -- start start 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.628+0000 7f677e68f740 1 Processor -- start 2024-09-12T02:07:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31f2e0 0x55cfbb329080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb324370 0x55cfbb3300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb327340 con 0x55cfbb324370 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb20b290 con 0x55cfbb31f2e0 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb3274c0 con 0x55cfbb31e9a0 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 10 client.0 _ll_register_callbacks cb 0x55cfbb23c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb324370 0x55cfbb3300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb324370 0x55cfbb3300c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40862/0 (socket says 172.21.15.100:40862) 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 -- 172.21.15.100:0/3871418216 learned_addr learned my addr 172.21.15.100:0/3871418216 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f67795ba640 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6778db9640 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31f2e0 0x55cfbb329080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 -- 172.21.15.100:0/3871418216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 msgr2=0x55cfbb328b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 -- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31f2e0 msgr2=0x55cfbb329080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31f2e0 0x55cfbb329080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 -- 172.21.15.100:0/3871418216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbaf95210 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f6779dbb640 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb324370 0x55cfbb3300c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f676c0128a0 tx=0x7f676c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed40696c8aa841b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f675cff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f675cff9640 1 -- 172.21.15.100:0/3871418216 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c01dd70 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f675cff9640 1 -- 172.21.15.100:0/3871418216 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f676c027470 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.629+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6770018070 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f675cff9640 1 -- 172.21.15.100:0/3871418216 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f676c012e20 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 10 client.15282 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cfbb061620 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f675cff9640 1 -- 172.21.15.100:0/3871418216 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6770018070 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f675cff9640 1 -- 172.21.15.100:0/3871418216 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f676c00f040 con 0x55cfbb324370 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 10 client.15282 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 10 client.15282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 20 client.15282 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb334830 0x55cfbb336c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 4 client.15282 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfbb28fa20 con 0x55cfbb334830 2024-09-12T02:07:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.630+0000 7f67795ba640 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb334830 0x55cfbb336c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.631+0000 7f675cff9640 10 client.15282 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.631+0000 7f67795ba640 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb334830 0x55cfbb336c90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5fff880d82b444a server_cookie=9a19a77a2c208286 in_seq=0 out_seq=0 2024-09-12T02:07:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.631+0000 7f675cff9640 1 -- 172.21.15.100:0/3871418216 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfbb28fa20 con 0x55cfbb334830 2024-09-12T02:07:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.631+0000 7f675cff9640 10 client.15282 handle_command_reply: tid=0 2024-09-12T02:07:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.631+0000 7f677e68f740 1 client.15282 shutdown 2024-09-12T02:07:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.631+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb324370 msgr2=0x55cfbb3300c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.631+0000 7f677e68f740 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb324370 0x55cfbb3300c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f676c0128a0 tx=0x7f676c004ab0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 shutdown_connections 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb334830 0x55cfbb336c90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb324370 0x55cfbb3300c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f675cff9640 0 client.15282 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31f2e0 0x55cfbb329080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 --2- 172.21.15.100:0/3871418216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 >> 172.21.15.100:0/3871418216 conn(0x55cfbb31a010 msgr2=0x55cfbb31b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 shutdown_connections 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 1 -- 172.21.15.100:0/3871418216 wait complete. 2024-09-12T02:07:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.632+0000 7f677e68f740 20 client.15282 trim_cache size 0 max 16384 2024-09-12T02:07:06.639 INFO:teuthology.orchestra.run.smithi100.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T02:07:06.640 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T02:07:06.640 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T02:07:06.640 DEBUG:tasks.quiescer:Yielding 2024-09-12T02:07:06.640 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T02:07:06.655 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:07:06.655 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:07:06.655 INFO:tasks.workunit:timeout=3h 2024-09-12T02:07:06.655 INFO:tasks.workunit:cleanup=True 2024-09-12T02:07:06.656 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:06.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 Processor -- start 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 -- start start 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb330080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb324370 0x55cfbb329080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67741adb30 con 0x55cfbb31f2e0 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67741ab400 con 0x55cfbb324370 2024-09-12T02:07:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f677e68f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67741a9250 con 0x55cfbb31e9a0 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb330080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb330080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40870/0 (socket says 172.21.15.100:40870) 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 -- 172.21.15.100:0/302241567 learned_addr learned my addr 172.21.15.100:0/302241567 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6779dbb640 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb324370 0x55cfbb329080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f67795ba640 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 -- 172.21.15.100:0/302241567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 msgr2=0x55cfbb328b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 -- 172.21.15.100:0/302241567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb324370 msgr2=0x55cfbb329080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb324370 0x55cfbb329080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6778db9640 1 -- 172.21.15.100:0/302241567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbb31f7c0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.647+0000 7f6779dbb640 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb324370 0x55cfbb329080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f6778db9640 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb330080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6768000c00 tx=0x7f676802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b83e53b926e65a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f675effd640 1 -- 172.21.15.100:0/302241567 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768049040 con 0x55cfbb31f2e0 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f675effd640 1 -- 172.21.15.100:0/302241567 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67680bc650 con 0x55cfbb31f2e0 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f675effd640 1 -- 172.21.15.100:0/302241567 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67680b85c0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f677e68f740 1 -- 172.21.15.100:0/302241567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 msgr2=0x55cfbb330080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f677e68f740 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb330080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6768000c00 tx=0x7f676802a410 comp rx=0 tx=0).stop 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f677e68f740 1 -- 172.21.15.100:0/302241567 shutdown_connections 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f677e68f740 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb324370 0x55cfbb329080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f677e68f740 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb330080 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f677e68f740 1 --2- 172.21.15.100:0/302241567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb31e9a0 0x55cfbb328b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.648+0000 7f677e68f740 1 -- 172.21.15.100:0/302241567 >> 172.21.15.100:0/302241567 conn(0x55cfbb31a010 msgr2=0x55cfbb3203c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 -- 172.21.15.100:0/302241567 shutdown_connections 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 -- 172.21.15.100:0/302241567 wait complete. 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 -- start start 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 Processor -- start 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb32db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb32e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb32f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67741a98c0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67741aad30 con 0x55cfbb31e9a0 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67741a9f90 con 0x55cfbb324370 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f677e68f740 10 client.0 _ll_register_callbacks cb 0x7f676c011f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f6778db9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb32e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f6778db9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb32e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40884/0 (socket says 172.21.15.100:40884) 2024-09-12T02:07:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f6778db9640 1 -- 172.21.15.100:0/220237506 learned_addr learned my addr 172.21.15.100:0/220237506 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.649+0000 7f67795ba640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb32db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6779dbb640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb32f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6778db9640 1 -- 172.21.15.100:0/220237506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 msgr2=0x55cfbb32f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6778db9640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb32f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6778db9640 1 -- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 msgr2=0x55cfbb32db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6778db9640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb32db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6778db9640 1 -- 172.21.15.100:0/220237506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbb32f6b0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6779dbb640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb32f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f6778db9640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb32e090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f67680b83b0 tx=0x7f676802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d732caf1b28bed2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f675cff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f675cff9640 1 -- 172.21.15.100:0/220237506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768049030 con 0x55cfbb31f2e0 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f675cff9640 1 -- 172.21.15.100:0/220237506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f67680bc1b0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67680bc650 con 0x55cfbb31f2e0 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f675cff9640 1 -- 172.21.15.100:0/220237506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67680bc430 con 0x55cfbb31f2e0 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 10 client.15288 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cfbb39f8a0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f675cff9640 1 -- 172.21.15.100:0/220237506 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67680bc650 con 0x55cfbb31f2e0 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f675cff9640 1 -- 172.21.15.100:0/220237506 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f67680c47c0 con 0x55cfbb31f2e0 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 10 client.15288 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 10 client.15288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 20 client.15288 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb3a0180 0x55cfbb3a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 4 client.15288 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:07:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.650+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cfbb289d70 con 0x55cfbb3a0180 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.651+0000 7f67795ba640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb3a0180 0x55cfbb3a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.651+0000 7f675cff9640 10 client.15288 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.651+0000 7f67795ba640 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb3a0180 0x55cfbb3a25a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139bb8d2da97bbc2 server_cookie=8bca002e467df23a in_seq=0 out_seq=0 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f675cff9640 1 -- 172.21.15.100:0/220237506 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cfbb289d70 con 0x55cfbb3a0180 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f675cff9640 10 client.15288 handle_command_reply: tid=0 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 client.15288 shutdown 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 msgr2=0x55cfbb32e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb32e090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f67680b83b0 tx=0x7f676802f000 comp rx=0 tx=0).stop 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 shutdown_connections 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55cfbb3a0180 0x55cfbb3a25a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cfbb324370 0x55cfbb32f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cfbb31f2e0 0x55cfbb32e090 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f675cff9640 0 client.15288 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 --2- 172.21.15.100:0/220237506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfbb31e9a0 0x55cfbb32db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 >> 172.21.15.100:0/220237506 conn(0x55cfbb31a010 msgr2=0x55cfbb3203c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 shutdown_connections 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 1 -- 172.21.15.100:0/220237506 wait complete. 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.662+0000 7f677e68f740 20 client.15288 trim_cache size 0 max 16384 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-09-12T02:07:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-09-12T02:07:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f67600a2cd0 msgr2=0x7f67600a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f67600a2cd0 0x7f67600a5190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f677406b1a0 tx=0x7f676c004a40 comp rx=0 tx=0).stop 2024-09-12T02:07:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 msgr2=0x7f6774100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f6774100580 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6768031440 tx=0x7f6768032e20 comp rx=0 tx=0).stop 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 shutdown_connections 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f67600a2cd0 0x7f67600a5190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6774107830 0x7f6774100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6774104f00 0x7f6774100580 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 --2- 172.21.15.100:0/599576363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67741025d0 0x7f6774101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 >> 172.21.15.100:0/599576363 conn(0x7f67740fc1b0 msgr2=0x7f6774102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 shutdown_connections 2024-09-12T02:07:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:06.663+0000 7f677b81e640 1 -- 172.21.15.100:0/599576363 wait complete. 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 02:05:25.400106080 +0000 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 02:05:25.400106080 +0000 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 02:06:45.099008383 +0000 2024-09-12T02:07:06.678 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 02:05:25.400106080 +0000 2024-09-12T02:07:06.679 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:07:06.679 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:07:06.752 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:07:06.808 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:07:06.913 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:07.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:07 smithi100 ceph-mon[31179]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T02:07:07.309 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:07 smithi100 ceph-mon[31179]: scrub summary: idle 2024-09-12T02:07:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:07 smithi117 ceph-mon[35240]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T02:07:07.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:07 smithi117 ceph-mon[35240]: scrub summary: idle 2024-09-12T02:07:07.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 -- 172.21.15.100:0/2635077261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384100e20 msgr2=0x7f5384101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 --2- 172.21.15.100:0/2635077261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384100e20 0x7f5384101200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5378009900 tx=0x7f537802a480 comp rx=0 tx=0).stop 2024-09-12T02:07:07.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 -- 172.21.15.100:0/2635077261 shutdown_connections 2024-09-12T02:07:07.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 --2- 172.21.15.100:0/2635077261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5384102ef0 0x7f538410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 --2- 172.21.15.100:0/2635077261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5384102570 0x7f53841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 --2- 172.21.15.100:0/2635077261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384100e20 0x7f5384101200 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 -- 172.21.15.100:0/2635077261 >> 172.21.15.100:0/2635077261 conn(0x7f53840fc7d0 msgr2=0x7f53840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:07.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 -- 172.21.15.100:0/2635077261 shutdown_connections 2024-09-12T02:07:07.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.388+0000 7f538ad14640 1 -- 172.21.15.100:0/2635077261 wait complete. 2024-09-12T02:07:07.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 Processor -- start 2024-09-12T02:07:07.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 -- start start 2024-09-12T02:07:07.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5384100e20 0x7f53840fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5384102570 0x7f53840fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384102ef0 0x7f53840fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5384110fa0 con 0x7f5384102ef0 2024-09-12T02:07:07.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5384110e20 con 0x7f5384102570 2024-09-12T02:07:07.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.389+0000 7f538ad14640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5384111120 con 0x7f5384100e20 2024-09-12T02:07:07.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384102ef0 0x7f53840fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384102ef0 0x7f53840fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40910/0 (socket says 172.21.15.100:40910) 2024-09-12T02:07:07.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 -- 172.21.15.100:0/2107164506 learned_addr learned my addr 172.21.15.100:0/2107164506 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:07.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f5388ab0640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5384100e20 0x7f53840fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f5383fff640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5384102570 0x7f53840fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 -- 172.21.15.100:0/2107164506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5384100e20 msgr2=0x7f53840fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5384100e20 0x7f53840fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 -- 172.21.15.100:0/2107164506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5384102570 msgr2=0x7f53840fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5384102570 0x7f53840fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 -- 172.21.15.100:0/2107164506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53841a69b0 con 0x7f5384102ef0 2024-09-12T02:07:07.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f5383fff640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5384102570 0x7f53840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:07.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f53892b1640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384102ef0 0x7f53840fd700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f537c00cce0 tx=0x7f537c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:07.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f5381ffb640 1 -- 172.21.15.100:0/2107164506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c00f450 con 0x7f5384102ef0 2024-09-12T02:07:07.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f5381ffb640 1 -- 172.21.15.100:0/2107164506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f537c00fad0 con 0x7f5384102ef0 2024-09-12T02:07:07.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53841a6ca0 con 0x7f5384102ef0 2024-09-12T02:07:07.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.390+0000 7f5381ffb640 1 -- 172.21.15.100:0/2107164506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c018c10 con 0x7f5384102ef0 2024-09-12T02:07:07.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.391+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53841a7190 con 0x7f5384102ef0 2024-09-12T02:07:07.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.392+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5384101200 con 0x7f5384102ef0 2024-09-12T02:07:07.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.393+0000 7f5381ffb640 1 -- 172.21.15.100:0/2107164506 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f537c00f5f0 con 0x7f5384102ef0 2024-09-12T02:07:07.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.393+0000 7f5381ffb640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53740a2c10 0x7f53740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:07.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.394+0000 7f5388ab0640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53740a2c10 0x7f53740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:07.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.394+0000 7f5381ffb640 1 -- 172.21.15.100:0/2107164506 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f537c0cf8b0 con 0x7f5384102ef0 2024-09-12T02:07:07.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.394+0000 7f5388ab0640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53740a2c10 0x7f53740a50d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f53780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:07.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.398+0000 7f5381ffb640 1 -- 172.21.15.100:0/2107164506 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f537c014030 con 0x7f5384102ef0 2024-09-12T02:07:07.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:07 smithi189 ceph-mon[35188]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T02:07:07.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:07 smithi189 ceph-mon[35188]: scrub summary: idle 2024-09-12T02:07:07.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.608+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f538410a0a0 con 0x7f5384102ef0 2024-09-12T02:07:07.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.608+0000 7f5381ffb640 1 -- 172.21.15.100:0/2107164506 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7f537c09c6c0 con 0x7f5384102ef0 2024-09-12T02:07:07.609 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:07:07.609 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:07:07.609 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:07:07.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.610+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53740a2c10 msgr2=0x7f53740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.610+0000 7f538ad14640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53740a2c10 0x7f53740a50d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f53780058d0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.610+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384102ef0 msgr2=0x7f53840fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.610+0000 7f538ad14640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384102ef0 0x7f53840fd700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f537c00cce0 tx=0x7f537c00a620 comp rx=0 tx=0).stop 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 shutdown_connections 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53740a2c10 0x7f53740a50d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384102ef0 0x7f53840fd700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5384102570 0x7f53840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 --2- 172.21.15.100:0/2107164506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5384100e20 0x7f53840fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 >> 172.21.15.100:0/2107164506 conn(0x7f53840fc7d0 msgr2=0x7f538406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 shutdown_connections 2024-09-12T02:07:07.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:07.611+0000 7f538ad14640 1 -- 172.21.15.100:0/2107164506 wait complete. 2024-09-12T02:07:08.291 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:08 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2107164506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:08.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:05:07.550581+0000', 'modified': '2024-09-12T02:06:45.807648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24452, 'mds_1': 24433, 'mds_2': 24428}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24410': {'gid': 24410, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3915021752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3915021752}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3915021752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/2566860695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 2566860695}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 2566860695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/3569067822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 3569067822}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 3569067822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.117:6837/137176693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 137176693}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 137176693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/2548139728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2548139728}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2548139728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6839/3211661343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 3211661343}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 3211661343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24452, 'qdb_cluster': [24428, 24433, 24452]} 2024-09-12T02:07:08.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:07:08.322 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:07:08.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:08 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2107164506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:08.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:08 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2107164506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:08.606 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 -- 172.21.15.100:0/3025018602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0100d00 msgr2=0x7fb5b0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 --2- 172.21.15.100:0/3025018602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0100d00 0x7fb5b0106840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb598009930 tx=0x7fb59802a420 comp rx=0 tx=0).stop 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 -- 172.21.15.100:0/3025018602 shutdown_connections 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 --2- 172.21.15.100:0/3025018602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5b0106f50 0x7fb5b010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 --2- 172.21.15.100:0/3025018602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0100d00 0x7fb5b0106840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 --2- 172.21.15.100:0/3025018602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5b0100350 0x7fb5b0100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 -- 172.21.15.100:0/3025018602 >> 172.21.15.100:0/3025018602 conn(0x7fb5b0077210 msgr2=0x7fb5b00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 -- 172.21.15.100:0/3025018602 shutdown_connections 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.076+0000 7fb5b6231640 1 -- 172.21.15.100:0/3025018602 wait complete. 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 Processor -- start 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 -- start start 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5b0100350 0x7fb5b01012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5b0100d00 0x7fb5b0101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0106f50 0x7fb5b0101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0111fa0 con 0x7fb5b0106f50 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0111e20 con 0x7fb5b0100350 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5b6231640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0112120 con 0x7fb5b0100d00 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0106f50 0x7fb5b0101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0106f50 0x7fb5b0101d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40930/0 (socket says 172.21.15.100:40930) 2024-09-12T02:07:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 -- 172.21.15.100:0/4029854108 learned_addr learned my addr 172.21.15.100:0/4029854108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5b0100d00 0x7fb5b0101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5b0100350 0x7fb5b01012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 -- 172.21.15.100:0/4029854108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5b0100d00 msgr2=0x7fb5b0101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5b0100d00 0x7fb5b0101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 -- 172.21.15.100:0/4029854108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5b0100350 msgr2=0x7fb5b01012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5b0100350 0x7fb5b01012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 -- 172.21.15.100:0/4029854108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b01a69a0 con 0x7fb5b0106f50 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5b0100350 0x7fb5b01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.077+0000 7fb5affff640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0106f50 0x7fb5b0101d50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800eaa0 tx=0x7fb5a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.078+0000 7fb5ad7fa640 1 -- 172.21.15.100:0/4029854108 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800cdb0 con 0x7fb5b0106f50 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.078+0000 7fb5ad7fa640 1 -- 172.21.15.100:0/4029854108 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5a8005020 con 0x7fb5b0106f50 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.078+0000 7fb5ad7fa640 1 -- 172.21.15.100:0/4029854108 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80116b0 con 0x7fb5b0106f50 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.078+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b01a6c90 con 0x7fb5b0106f50 2024-09-12T02:07:09.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.078+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b01a71d0 con 0x7fb5b0106f50 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.080+0000 7fb5ad7fa640 1 -- 172.21.15.100:0/4029854108 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb5a8005560 con 0x7fb5b0106f50 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.080+0000 7fb5b860a740 1 Processor -- start 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.080+0000 7fb5b860a740 1 -- start start 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6789d0 0x55f59c678db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c683670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c685fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5b860a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f59c5df090 con 0x55f59c683bb0 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5b860a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f59c586a70 con 0x55f59c6792f0 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5b860a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f59c5db050 con 0x55f59c6789d0 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c685fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5af7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c683670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c685fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40932/0 (socket says 172.21.15.100:40932) 2024-09-12T02:07:09.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5a7fff640 1 -- 172.21.15.100:0/1682496626 learned_addr learned my addr 172.21.15.100:0/1682496626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5ad7fa640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb59c0a2c10 0x7fb59c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6789d0 0x55f59c678db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5affff640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb59c0a2c10 0x7fb59c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5af7fe640 1 -- 172.21.15.100:0/1682496626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6789d0 msgr2=0x55f59c678db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5ad7fa640 1 -- 172.21.15.100:0/4029854108 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb5a80cf470 con 0x7fb5b0106f50 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6789d0 0x55f59c678db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5af7fe640 1 -- 172.21.15.100:0/1682496626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 msgr2=0x55f59c685fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c685fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5af7fe640 1 -- 172.21.15.100:0/1682496626 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59c593130 con 0x55f59c6792f0 2024-09-12T02:07:09.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c685fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:09.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c683670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000bab0 tx=0x7fb5a000bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43db802cf03d201 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.081+0000 7fb5affff640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb59c0a2c10 0x7fb59c0a50d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb5a809bab0 tx=0x7fb5a804b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5a5ffb640 1 -- 172.21.15.100:0/1682496626 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0017420 con 0x55f59c6792f0 2024-09-12T02:07:09.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5a5ffb640 1 -- 172.21.15.100:0/1682496626 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5a0017aa0 con 0x55f59c6792f0 2024-09-12T02:07:09.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5a5ffb640 1 -- 172.21.15.100:0/1682496626 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000fa80 con 0x55f59c6792f0 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 -- 172.21.15.100:0/1682496626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 msgr2=0x55f59c683670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c683670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000bab0 tx=0x7fb5a000bf70 comp rx=0 tx=0).stop 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 -- 172.21.15.100:0/1682496626 shutdown_connections 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c685fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c683670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1682496626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6789d0 0x55f59c678db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 -- 172.21.15.100:0/1682496626 >> 172.21.15.100:0/1682496626 conn(0x55f59c674f60 msgr2=0x55f59c675340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 -- 172.21.15.100:0/1682496626 shutdown_connections 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.082+0000 7fb5b860a740 1 -- 172.21.15.100:0/1682496626 wait complete. 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 -- start start 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 Processor -- start 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c683310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c6806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c680bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f59c686780 con 0x55f59c683bb0 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f59c599f20 con 0x55f59c6789d0 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f59c686900 con 0x55f59c6792f0 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5b860a740 10 client.0 _ll_register_callbacks cb 0x55f59c563030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c680bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c683310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c683310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:46112/0 (socket says 172.21.15.100:46112) 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5a7fff640 1 -- 172.21.15.100:0/1698689573 learned_addr learned my addr 172.21.15.100:0/1698689573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.083+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c6806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5a7fff640 1 -- 172.21.15.100:0/1698689573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 msgr2=0x55f59c6806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c6806b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5a7fff640 1 -- 172.21.15.100:0/1698689573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 msgr2=0x55f59c680bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c680bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5a7fff640 1 -- 172.21.15.100:0/1698689573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f59c3502b0 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c683310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb598009900 tx=0x7fb598000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27db5c64c5b0cebb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb58effd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb58effd640 1 -- 172.21.15.100:0/1698689573 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598035040 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a0017aa0 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb58effd640 1 -- 172.21.15.100:0/1698689573 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb5980037f0 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb58effd640 1 -- 172.21.15.100:0/1698689573 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb598053050 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5b860a740 10 client.24848 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f59c692030 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.084+0000 7fb58effd640 1 -- 172.21.15.100:0/1698689573 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5a0017aa0 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb58effd640 1 -- 172.21.15.100:0/1698689573 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb59803a070 con 0x55f59c6789d0 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5b860a740 10 client.24848 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:09.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5b860a740 10 client.24848 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5b860a740 20 client.24848 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c6945a0 0x55f59c695a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5b860a740 4 client.24848 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f59c5ec600 con 0x55f59c6945a0 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c6945a0 0x55f59c695a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c6945a0 0x55f59c695a10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac132b690cc4050c server_cookie=45404263e68d68e4 in_seq=0 out_seq=0 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.085+0000 7fb58effd640 10 client.24848 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb58effd640 1 -- 172.21.15.100:0/1698689573 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f59c5ec600 con 0x55f59c6945a0 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb58effd640 10 client.24848 handle_command_reply: tid=0 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 client.24848 shutdown 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 msgr2=0x55f59c683310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c683310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb598009900 tx=0x7fb598000bc0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 shutdown_connections 2024-09-12T02:07:09.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c6945a0 0x55f59c695a10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c680bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb58effd640 0 client.24848 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c6806b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 --2- 172.21.15.100:0/1698689573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c683310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 >> 172.21.15.100:0/1698689573 conn(0x55f59c674f60 msgr2=0x55f59c67ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 shutdown_connections 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 1 -- 172.21.15.100:0/1698689573 wait complete. 2024-09-12T02:07:09.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.086+0000 7fb5b860a740 20 client.24848 trim_cache size 0 max 16384 2024-09-12T02:07:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 Processor -- start 2024-09-12T02:07:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 -- start start 2024-09-12T02:07:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c695a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c67ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c67f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f59c693d50 con 0x55f59c683bb0 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f59c694420 con 0x55f59c6789d0 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5b860a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f59c694af0 con 0x55f59c6792f0 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c67f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c67f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40948/0 (socket says 172.21.15.100:40948) 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5a7fff640 1 -- 172.21.15.100:0/3446276972 learned_addr learned my addr 172.21.15.100:0/3446276972 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c695a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.104+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c67ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a7fff640 1 -- 172.21.15.100:0/3446276972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 msgr2=0x55f59c67ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c67ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a7fff640 1 -- 172.21.15.100:0/3446276972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 msgr2=0x55f59c695a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c695a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a7fff640 1 -- 172.21.15.100:0/3446276972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59c674d90 con 0x55f59c683bb0 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c67f4c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb598009850 tx=0x7fb598032e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d29bce909bc9863 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a57fa640 1 -- 172.21.15.100:0/3446276972 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598035070 con 0x55f59c683bb0 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a57fa640 1 -- 172.21.15.100:0/3446276972 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb59803dda0 con 0x55f59c683bb0 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.105+0000 7fb5a57fa640 1 -- 172.21.15.100:0/3446276972 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598003a30 con 0x55f59c683bb0 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- 172.21.15.100:0/3446276972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 msgr2=0x55f59c67f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c67f4c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb598009850 tx=0x7fb598032e00 comp rx=0 tx=0).stop 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- 172.21.15.100:0/3446276972 shutdown_connections 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c683bb0 0x55f59c67f4c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c6792f0 0x55f59c67ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 --2- 172.21.15.100:0/3446276972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6789d0 0x55f59c695a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- 172.21.15.100:0/3446276972 >> 172.21.15.100:0/3446276972 conn(0x55f59c674f60 msgr2=0x55f59c66fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- 172.21.15.100:0/3446276972 shutdown_connections 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- 172.21.15.100:0/3446276972 wait complete. 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- start start 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 Processor -- start 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c6789d0 0x55f59c69e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c699670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c683bb0 0x55f59c699bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f59c695890 con 0x55f59c6789d0 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f59c6951c0 con 0x55f59c6792f0 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f59c695f60 con 0x55f59c683bb0 2024-09-12T02:07:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.106+0000 7fb5b860a740 10 client.0 _ll_register_callbacks cb 0x7fb598004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c6789d0 0x55f59c69e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c6789d0 0x55f59c69e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40958/0 (socket says 172.21.15.100:40958) 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 -- 172.21.15.100:0/623141480 learned_addr learned my addr 172.21.15.100:0/623141480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c699670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c683bb0 0x55f59c699bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 -- 172.21.15.100:0/623141480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c683bb0 msgr2=0x55f59c699bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c683bb0 0x55f59c699bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 -- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 msgr2=0x55f59c699670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c699670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 -- 172.21.15.100:0/623141480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f59c69a2a0 con 0x55f59c6789d0 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5a7fff640 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c6789d0 0x55f59c69e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb5980096a0 tx=0x7fb5980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665b429fc97a91d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb58effd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb58effd640 1 -- 172.21.15.100:0/623141480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598035040 con 0x55f59c6789d0 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb58effd640 1 -- 172.21.15.100:0/623141480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb59803d670 con 0x55f59c6789d0 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb59803dda0 con 0x55f59c6789d0 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb58effd640 1 -- 172.21.15.100:0/623141480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb5980037b0 con 0x55f59c6789d0 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5b860a740 10 client.15312 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.107+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f59c707380 con 0x55f59c6789d0 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb58effd640 1 -- 172.21.15.100:0/623141480 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb59803dda0 con 0x55f59c6789d0 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb58effd640 1 -- 172.21.15.100:0/623141480 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb59803a040 con 0x55f59c6789d0 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5b860a740 10 client.15312 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5b860a740 10 client.15312 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5b860a740 20 client.15312 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5b860a740 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c70bd30 0x55f59c70aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5b860a740 4 client.15312 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:07:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "status"}) -- 0x55f59c5e6b10 con 0x55f59c70bd30 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c70bd30 0x55f59c70aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb5af7fe640 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c70bd30 0x55f59c70aa40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=12ddb40de7398b0d server_cookie=9af68b33f4824387 in_seq=0 out_seq=0 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.108+0000 7fb58effd640 10 client.15312 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb58effd640 1 -- 172.21.15.100:0/623141480 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f59c5e6b10 con 0x55f59c70bd30 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb58effd640 10 client.15312 handle_command_reply: tid=0 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 client.15312 shutdown 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c6789d0 msgr2=0x55f59c69e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c6789d0 0x55f59c69e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb5980096a0 tx=0x7fb5980045e0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 shutdown_connections 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55f59c70bd30 0x55f59c70aa40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59c683bb0 0x55f59c699bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f59c6792f0 0x55f59c699670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 --2- 172.21.15.100:0/623141480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f59c6789d0 0x55f59c69e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb58effd640 0 client.15312 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:09.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 >> 172.21.15.100:0/623141480 conn(0x55f59c674f60 msgr2=0x55f59c67ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 shutdown_connections 2024-09-12T02:07:09.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 1 -- 172.21.15.100:0/623141480 wait complete. 2024-09-12T02:07:09.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.109+0000 7fb5b860a740 20 client.15312 trim_cache size 0 max 16384 2024-09-12T02:07:09.117 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24428, 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 113.02542856399999, 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 143.647467304 2024-09-12T02:07:09.118 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:09.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb59c0a2c10 msgr2=0x7fb59c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb59c0a2c10 0x7fb59c0a50d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb5a809bab0 tx=0x7fb5a804b040 comp rx=0 tx=0).stop 2024-09-12T02:07:09.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0106f50 msgr2=0x7fb5b0101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:09.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0106f50 0x7fb5b0101d50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800eaa0 tx=0x7fb5a800ef60 comp rx=0 tx=0).stop 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 shutdown_connections 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb59c0a2c10 0x7fb59c0a50d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b0106f50 0x7fb5b0101d50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5b0100d00 0x7fb5b0101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 --2- 172.21.15.100:0/4029854108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5b0100350 0x7fb5b01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 >> 172.21.15.100:0/4029854108 conn(0x7fb5b0077210 msgr2=0x7fb5b01051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 shutdown_connections 2024-09-12T02:07:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:09.110+0000 7fb5b6231640 1 -- 172.21.15.100:0/4029854108 wait complete. 2024-09-12T02:07:09.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:09 smithi100 ceph-mon[31179]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:07:09.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:09 smithi117 ceph-mon[35240]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:07:09.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:09 smithi189 ceph-mon[35188]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:07:09.769 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:07:10.027 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:10.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:10 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:10.436 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:10 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 -- 172.21.15.100:0/1529662006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41027a0 msgr2=0x7f4ba41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 --2- 172.21.15.100:0/1529662006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41027a0 0x7f4ba41067f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009900 tx=0x7f4b9402a410 comp rx=0 tx=0).stop 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 -- 172.21.15.100:0/1529662006 shutdown_connections 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 --2- 172.21.15.100:0/1529662006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba4106f20 0x7f4ba410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 --2- 172.21.15.100:0/1529662006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba41027a0 0x7f4ba41067f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 --2- 172.21.15.100:0/1529662006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4101df0 0x7f4ba41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 -- 172.21.15.100:0/1529662006 >> 172.21.15.100:0/1529662006 conn(0x7f4ba40fd8b0 msgr2=0x7f4ba40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.519+0000 7f4bac335640 1 -- 172.21.15.100:0/1529662006 shutdown_connections 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 -- 172.21.15.100:0/1529662006 wait complete. 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 Processor -- start 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 -- start start 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4101df0 0x7f4ba40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba41027a0 0x7f4ba4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba4106f20 0x7f4ba4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4111f80 con 0x7f4ba4106f20 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4111e00 con 0x7f4ba4101df0 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4bac335640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4112100 con 0x7f4ba41027a0 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4baa8d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba4106f20 0x7f4ba4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4baa8d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba4106f20 0x7f4ba4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40980/0 (socket says 172.21.15.100:40980) 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.520+0000 7f4baa8d2640 1 -- 172.21.15.100:0/772018053 learned_addr learned my addr 172.21.15.100:0/772018053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba41027a0 0x7f4ba4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4101df0 0x7f4ba40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4baa8d2640 1 -- 172.21.15.100:0/772018053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba41027a0 msgr2=0x7f4ba4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba41027a0 0x7f4ba4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4baa8d2640 1 -- 172.21.15.100:0/772018053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4101df0 msgr2=0x7f4ba40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4101df0 0x7f4ba40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4baa8d2640 1 -- 172.21.15.100:0/772018053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba41a68e0 con 0x7f4ba4106f20 2024-09-12T02:07:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba4106f20 0x7f4ba4074f70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00d750 tx=0x7f4b9c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4b9b7fe640 1 -- 172.21.15.100:0/772018053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c017070 con 0x7f4ba4106f20 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4b9b7fe640 1 -- 172.21.15.100:0/772018053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b9c005500 con 0x7f4ba4106f20 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4b9b7fe640 1 -- 172.21.15.100:0/772018053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004d90 con 0x7f4ba4106f20 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba41a6bd0 con 0x7f4ba4106f20 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.521+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba41a70c0 con 0x7f4ba4106f20 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.523+0000 7f4b9b7fe640 1 -- 172.21.15.100:0/772018053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4b9c004f30 con 0x7f4ba4106f20 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 Processor -- start 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 -- start start 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4b9b7fe640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b900a2c10 0x7f4b900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7164670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f2a70c0090 con 0x55f2a715a2f0 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f2a7067a70 con 0x55f2a7164bb0 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4bae70e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f2a70bc050 con 0x55f2a71599d0 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b900a2c10 0x7f4b900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4b9b7fe640 1 -- 172.21.15.100:0/772018053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4b9c0ceb70 con 0x7f4ba4106f20 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4ba98d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7164670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4ba98d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7164670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40990/0 (socket says 172.21.15.100:40990) 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.524+0000 7f4ba98d0640 1 -- 172.21.15.100:0/3703149931 learned_addr learned my addr 172.21.15.100:0/3703149931 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa0d1640 1 -- 172.21.15.100:0/3703149931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 msgr2=0x55f2a7166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa0d1640 1 -- 172.21.15.100:0/3703149931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 msgr2=0x55f2a7164670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7164670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa0d1640 1 -- 172.21.15.100:0/3703149931 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a7074130 con 0x55f2a71599d0 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7164670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b900a2c10 0x7f4b900a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b94005940 tx=0x7f4b94005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7159db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009ec0 tx=0x7f4ba0010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7a6f5eee61f1d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4b98dea640 1 -- 172.21.15.100:0/3703149931 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0016070 con 0x55f2a71599d0 2024-09-12T02:07:10.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4b98dea640 1 -- 172.21.15.100:0/3703149931 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba001bb40 con 0x55f2a71599d0 2024-09-12T02:07:10.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.525+0000 7f4b98dea640 1 -- 172.21.15.100:0/3703149931 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0012c90 con 0x55f2a71599d0 2024-09-12T02:07:10.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 -- 172.21.15.100:0/3703149931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 msgr2=0x55f2a7159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7159db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009ec0 tx=0x7f4ba0010740 comp rx=0 tx=0).stop 2024-09-12T02:07:10.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 -- 172.21.15.100:0/3703149931 shutdown_connections 2024-09-12T02:07:10.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7164670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3703149931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7159db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 -- 172.21.15.100:0/3703149931 >> 172.21.15.100:0/3703149931 conn(0x55f2a7155f60 msgr2=0x55f2a7156340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 -- 172.21.15.100:0/3703149931 shutdown_connections 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 -- 172.21.15.100:0/3703149931 wait complete. 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 -- start start 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.526+0000 7f4bae70e740 1 Processor -- start 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7164440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f2a7167780 con 0x55f2a715a2f0 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f2a707af20 con 0x55f2a7164bb0 2024-09-12T02:07:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f2a7167900 con 0x55f2a71599d0 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 10 client.0 _ll_register_callbacks cb 0x55f2a7044030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7161790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41006/0 (socket says 172.21.15.100:41006) 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 -- 172.21.15.100:0/3720653739 learned_addr learned my addr 172.21.15.100:0/3720653739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 -- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 msgr2=0x55f2a7164440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7164440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 -- 172.21.15.100:0/3720653739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 msgr2=0x55f2a7161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 -- 172.21.15.100:0/3720653739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a6e312b0 con 0x55f2a715a2f0 2024-09-12T02:07:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7161790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b94005e90 tx=0x7f4b94045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77f2265195d7033 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4b8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4b8dffb640 1 -- 172.21.15.100:0/3720653739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9404e030 con 0x55f2a715a2f0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4b8dffb640 1 -- 172.21.15.100:0/3720653739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4b94005030 con 0x55f2a715a2f0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.527+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba001bb40 con 0x55f2a715a2f0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4b8dffb640 1 -- 172.21.15.100:0/3720653739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b94035040 con 0x55f2a715a2f0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 10 client.15324 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f2a7173090 con 0x55f2a715a2f0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4b8dffb640 1 -- 172.21.15.100:0/3720653739 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba001bb40 con 0x55f2a715a2f0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4b8dffb640 1 -- 172.21.15.100:0/3720653739 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4b9403a040 con 0x55f2a715a2f0 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 10 client.15324 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 10 client.15324 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:07:10.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 20 client.15324 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71756f0 0x55f2a7176b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 4 client.15324 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2a70cd600 con 0x55f2a71756f0 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.528+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71756f0 0x55f2a7176b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71756f0 0x55f2a7176b60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39288a88c49ce488 server_cookie=65e0b01fed14f9ff in_seq=0 out_seq=0 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4b8dffb640 10 client.15324 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4b8dffb640 1 -- 172.21.15.100:0/3720653739 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2a70cd600 con 0x55f2a71756f0 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4b8dffb640 10 client.15324 handle_command_reply: tid=0 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 client.15324 shutdown 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 msgr2=0x55f2a7161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7161790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b94005e90 tx=0x7f4b94045000 comp rx=0 tx=0).stop 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 shutdown_connections 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a7164bb0 0x55f2a7161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a715a2f0 0x55f2a7161790 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71756f0 0x55f2a7176b60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.529+0000 7f4bae70e740 1 --2- 172.21.15.100:0/3720653739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a71599d0 0x55f2a7164440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.530+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 >> 172.21.15.100:0/3720653739 conn(0x55f2a7155f60 msgr2=0x55f2a715bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.530+0000 7f4b8dffb640 0 client.15324 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.530+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 shutdown_connections 2024-09-12T02:07:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.530+0000 7f4bae70e740 1 -- 172.21.15.100:0/3720653739 wait complete. 2024-09-12T02:07:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.530+0000 7f4bae70e740 20 client.15324 trim_cache size 0 max 16384 2024-09-12T02:07:10.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.547+0000 7f4bae70e740 1 Processor -- start 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.547+0000 7f4bae70e740 1 -- start start 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a71599d0 0x55f2a7175dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a715a2f0 0x55f2a7150df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a7164bb0 0x55f2a71600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4bae70e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f2a7174ea0 con 0x55f2a7164bb0 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4bae70e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f2a7175570 con 0x55f2a71599d0 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4bae70e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f2a7175c40 con 0x55f2a715a2f0 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa8d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a7164bb0 0x55f2a71600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa0d1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a71599d0 0x55f2a7175dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa8d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a7164bb0 0x55f2a71600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41016/0 (socket says 172.21.15.100:41016) 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa8d2640 1 -- 172.21.15.100:0/1454269158 learned_addr learned my addr 172.21.15.100:0/1454269158 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a715a2f0 0x55f2a7150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa0d1640 1 -- 172.21.15.100:0/1454269158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a715a2f0 msgr2=0x55f2a7150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a715a2f0 0x55f2a7150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa0d1640 1 -- 172.21.15.100:0/1454269158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a7164bb0 msgr2=0x55f2a71600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a7164bb0 0x55f2a71600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa0d1640 1 -- 172.21.15.100:0/1454269158 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a7159800 con 0x55f2a71599d0 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a7164bb0 0x55f2a71600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a71599d0 0x55f2a7175dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0000f80 tx=0x7f4ba00127f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d357d2f8885b8e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.548+0000 7f4b8ffff640 1 -- 172.21.15.100:0/1454269158 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0016040 con 0x55f2a71599d0 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4b8ffff640 1 -- 172.21.15.100:0/1454269158 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0003e50 con 0x55f2a71599d0 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4b8ffff640 1 -- 172.21.15.100:0/1454269158 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0005620 con 0x55f2a71599d0 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 -- 172.21.15.100:0/1454269158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a71599d0 msgr2=0x55f2a7175dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a71599d0 0x55f2a7175dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0000f80 tx=0x7f4ba00127f0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 -- 172.21.15.100:0/1454269158 shutdown_connections 2024-09-12T02:07:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a7164bb0 0x55f2a71600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a715a2f0 0x55f2a7150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 --2- 172.21.15.100:0/1454269158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a71599d0 0x55f2a7175dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 -- 172.21.15.100:0/1454269158 >> 172.21.15.100:0/1454269158 conn(0x55f2a7155f60 msgr2=0x55f2a7156340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 -- 172.21.15.100:0/1454269158 shutdown_connections 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.549+0000 7f4bae70e740 1 -- 172.21.15.100:0/1454269158 wait complete. 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 -- start start 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 Processor -- start 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a71599d0 0x55f2a71d8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a715a2f0 0x55f2a71d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a7164bb0 0x55f2a717a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f2a71769e0 con 0x55f2a71599d0 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f2a7176310 con 0x55f2a715a2f0 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f2a71770b0 con 0x55f2a7164bb0 2024-09-12T02:07:10.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4bae70e740 10 client.0 _ll_register_callbacks cb 0x7f4b94005dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a71599d0 0x55f2a71d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a71599d0 0x55f2a71d8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41022/0 (socket says 172.21.15.100:41022) 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 -- 172.21.15.100:0/2384598435 learned_addr learned my addr 172.21.15.100:0/2384598435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a715a2f0 0x55f2a71d85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa8d2640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a7164bb0 0x55f2a717a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 -- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a7164bb0 msgr2=0x55f2a717a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a7164bb0 0x55f2a717a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 -- 172.21.15.100:0/2384598435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a715a2f0 msgr2=0x55f2a71d85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a715a2f0 0x55f2a71d85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.550+0000 7f4baa0d1640 1 -- 172.21.15.100:0/2384598435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a717aa80 con 0x55f2a71599d0 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a715a2f0 0x55f2a71d85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4baa0d1640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a71599d0 0x55f2a71d8080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0006010 tx=0x7f4ba0009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803c8d440de9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4b8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4b8dffb640 1 -- 172.21.15.100:0/2384598435 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0038060 con 0x55f2a71599d0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4b8dffb640 1 -- 172.21.15.100:0/2384598435 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4ba0003b70 con 0x55f2a71599d0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba0003e50 con 0x55f2a71599d0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4b8dffb640 1 -- 172.21.15.100:0/2384598435 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ba0016050 con 0x55f2a71599d0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4bae70e740 10 client.15330 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f2a71df8e0 con 0x55f2a71599d0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.551+0000 7f4b8dffb640 1 -- 172.21.15.100:0/2384598435 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0003e50 con 0x55f2a71599d0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4b8dffb640 1 -- 172.21.15.100:0/2384598435 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4ba000f040 con 0x55f2a71599d0 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4bae70e740 10 client.15330 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4bae70e740 10 client.15330 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4bae70e740 20 client.15330 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4bae70e740 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71e3d40 0x55f2a71e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:10.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4bae70e740 4 client.15330 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "status"}) -- 0x55f2a70c7b10 con 0x55f2a71e3d40 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71e3d40 0x55f2a71e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4ba98d0640 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71e3d40 0x55f2a71e2a50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a67d074b1ae234a5 server_cookie=3770b025b0b71927 in_seq=0 out_seq=0 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4b8dffb640 10 client.15330 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4b8dffb640 1 -- 172.21.15.100:0/2384598435 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f2a70c7b10 con 0x55f2a71e3d40 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4b8dffb640 10 client.15330 handle_command_reply: tid=0 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.552+0000 7f4bae70e740 1 client.15330 shutdown 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a71599d0 msgr2=0x55f2a71d8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a71599d0 0x55f2a71d8080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0006010 tx=0x7f4ba0009e70 comp rx=0 tx=0).stop 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 shutdown_connections 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55f2a71e3d40 0x55f2a71e2a50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f2a7164bb0 0x55f2a717a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4b8dffb640 0 client.15330 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f2a715a2f0 0x55f2a71d85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 --2- 172.21.15.100:0/2384598435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2a71599d0 0x55f2a71d8080 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 >> 172.21.15.100:0/2384598435 conn(0x55f2a7155f60 msgr2=0x55f2a715fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 shutdown_connections 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 1 -- 172.21.15.100:0/2384598435 wait complete. 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bae70e740 20 client.15330 trim_cache size 0 max 16384 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24433, 2024-09-12T02:07:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 115.47872039000001, 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 142.65719071199999 2024-09-12T02:07:10.569 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b900a2c10 msgr2=0x7f4b900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b900a2c10 0x7f4b900a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b94005940 tx=0x7f4b94005d50 comp rx=0 tx=0).stop 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba4106f20 msgr2=0x7f4ba4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba4106f20 0x7f4ba4074f70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00d750 tx=0x7f4b9c00dc10 comp rx=0 tx=0).stop 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 shutdown_connections 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b900a2c10 0x7f4b900a50d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba4106f20 0x7f4ba4074f70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.553+0000 7f4bac335640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba41027a0 0x7f4ba4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.554+0000 7f4bac335640 1 --2- 172.21.15.100:0/772018053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba4101df0 0x7f4ba40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:10.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.554+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 >> 172.21.15.100:0/772018053 conn(0x7f4ba40fd8b0 msgr2=0x7f4ba40feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:10.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.554+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 shutdown_connections 2024-09-12T02:07:10.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:10.554+0000 7f4bac335640 1 -- 172.21.15.100:0/772018053 wait complete. 2024-09-12T02:07:10.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:10 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:11.359 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:07:11.386 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:11 smithi100 ceph-mon[31179]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-12T02:07:11.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:11 smithi117 ceph-mon[35240]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-12T02:07:11.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:11 smithi189 ceph-mon[35188]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-12T02:07:12.018 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:12.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.530+0000 7f8915474640 1 -- 172.21.15.100:0/285714671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910102570 msgr2=0x7f89101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.530+0000 7f8915474640 1 --2- 172.21.15.100:0/285714671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910102570 0x7f89101029b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8904009900 tx=0x7f890402a480 comp rx=0 tx=0).stop 2024-09-12T02:07:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.530+0000 7f8915474640 1 -- 172.21.15.100:0/285714671 shutdown_connections 2024-09-12T02:07:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.530+0000 7f8915474640 1 --2- 172.21.15.100:0/285714671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8910102ef0 0x7f891010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.530+0000 7f8915474640 1 --2- 172.21.15.100:0/285714671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910102570 0x7f89101029b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.530+0000 7f8915474640 1 --2- 172.21.15.100:0/285714671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8910100e20 0x7f8910101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.530+0000 7f8915474640 1 -- 172.21.15.100:0/285714671 >> 172.21.15.100:0/285714671 conn(0x7f89100fc7d0 msgr2=0x7f89100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:12.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 -- 172.21.15.100:0/285714671 shutdown_connections 2024-09-12T02:07:12.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 -- 172.21.15.100:0/285714671 wait complete. 2024-09-12T02:07:12.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 Processor -- start 2024-09-12T02:07:12.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 -- start start 2024-09-12T02:07:12.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910100e20 0x7f8910198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8910102570 0x7f8910198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8910102ef0 0x7f891019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8910110fa0 con 0x7f8910100e20 2024-09-12T02:07:12.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8910110e20 con 0x7f8910102ef0 2024-09-12T02:07:12.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.531+0000 7f8915474640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8910111120 con 0x7f8910102570 2024-09-12T02:07:12.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910100e20 0x7f8910198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910100e20 0x7f8910198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41036/0 (socket says 172.21.15.100:41036) 2024-09-12T02:07:12.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 -- 172.21.15.100:0/1032402113 learned_addr learned my addr 172.21.15.100:0/1032402113 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:12.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890e7fc640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8910102570 0x7f8910198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8910102ef0 0x7f891019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 -- 172.21.15.100:0/1032402113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8910102570 msgr2=0x7f8910198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8910102570 0x7f8910198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 -- 172.21.15.100:0/1032402113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8910102ef0 msgr2=0x7f891019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8910102ef0 0x7f891019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 -- 172.21.15.100:0/1032402113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891019d4f0 con 0x7f8910100e20 2024-09-12T02:07:12.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f890effd640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910100e20 0x7f8910198540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f890000e9f0 tx=0x7f890000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:12.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f88f7fff640 1 -- 172.21.15.100:0/1032402113 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890000cd80 con 0x7f8910100e20 2024-09-12T02:07:12.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891019d7e0 con 0x7f8910100e20 2024-09-12T02:07:12.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f88f7fff640 1 -- 172.21.15.100:0/1032402113 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8900010910 con 0x7f8910100e20 2024-09-12T02:07:12.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f88f7fff640 1 -- 172.21.15.100:0/1032402113 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89000188f0 con 0x7f8910100e20 2024-09-12T02:07:12.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.532+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89101a50c0 con 0x7f8910100e20 2024-09-12T02:07:12.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f88f7fff640 1 -- 172.21.15.100:0/1032402113 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8900018b70 con 0x7f8910100e20 2024-09-12T02:07:12.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 Processor -- start 2024-09-12T02:07:12.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 -- start start 2024-09-12T02:07:12.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c2adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c35670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440c37fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d440b91090 con 0x55d440c35bb0 2024-09-12T02:07:12.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d440b38a70 con 0x55d440c2a9d0 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f891784d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d440b8d050 con 0x55d440c2b2f0 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440c37fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f88f7fff640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f88f80a2c10 0x7f88f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440c37fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41044/0 (socket says 172.21.15.100:41044) 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f890e7fc640 1 -- 172.21.15.100:0/1542087238 learned_addr learned my addr 172.21.15.100:0/1542087238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c2adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f890effd640 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c35670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.535+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f88f80a2c10 0x7f88f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f88f7fff640 1 -- 172.21.15.100:0/1032402113 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89000cf4c0 con 0x7f8910100e20 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f890e7fc640 1 -- 172.21.15.100:0/1542087238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 msgr2=0x55d440c35670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f890e7fc640 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c35670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f890e7fc640 1 -- 172.21.15.100:0/1542087238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 msgr2=0x55d440c2adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f890e7fc640 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c2adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f890e7fc640 1 -- 172.21.15.100:0/1542087238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440b45130 con 0x55d440c35bb0 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f890e7fc640 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440c37fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8904009900 tx=0x7f89040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0e1a64bd95c010 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f88f80a2c10 0x7f88f80a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8908009900 tx=0x7f8908009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f88f57fa640 1 -- 172.21.15.100:0/1542087238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904035030 con 0x55d440c35bb0 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f88f57fa640 1 -- 172.21.15.100:0/1542087238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904040070 con 0x55d440c35bb0 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.536+0000 7f88f57fa640 1 -- 172.21.15.100:0/1542087238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904031a10 con 0x55d440c35bb0 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 -- 172.21.15.100:0/1542087238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 msgr2=0x55d440c37fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440c37fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8904009900 tx=0x7f89040040c0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 -- 172.21.15.100:0/1542087238 shutdown_connections 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440c37fa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c35670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 --2- 172.21.15.100:0/1542087238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c2adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 -- 172.21.15.100:0/1542087238 >> 172.21.15.100:0/1542087238 conn(0x55d440c26f60 msgr2=0x55d440c27340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 -- 172.21.15.100:0/1542087238 shutdown_connections 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 -- 172.21.15.100:0/1542087238 wait complete. 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 -- start start 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 Processor -- start 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2a9d0 0x55d440c353c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c32710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.537+0000 7f891784d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c35bb0 0x55d440c32c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f891784d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d440c38780 con 0x55d440c2a9d0 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f891784d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d440b4bf20 con 0x55d440c35bb0 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f891784d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d440c38900 con 0x55d440c2b2f0 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f891784d740 10 client.0 _ll_register_callbacks cb 0x55d440b15030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:12.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2a9d0 0x55d440c353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2a9d0 0x55d440c353c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41048/0 (socket says 172.21.15.100:41048) 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 -- 172.21.15.100:0/1740810896 learned_addr learned my addr 172.21.15.100:0/1740810896 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890e7fc640 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c32710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c35bb0 0x55d440c32c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 -- 172.21.15.100:0/1740810896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 msgr2=0x55d440c32710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c32710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 -- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c35bb0 msgr2=0x55d440c32c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c35bb0 0x55d440c32c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 -- 172.21.15.100:0/1740810896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4409022b0 con 0x55d440c2a9d0 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f890effd640 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2a9d0 0x55d440c353c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8900018500 tx=0x7f890006ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c0c244b92387fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f88f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1740810896 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890009ff20 con 0x55d440c2a9d0 2024-09-12T02:07:12.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1740810896 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f890009b070 con 0x55d440c2a9d0 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8904040070 con 0x55d440c2a9d0 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1740810896 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f89000a47e0 con 0x55d440c2a9d0 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f891784d740 10 client.15342 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.538+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d440c48480 con 0x55d440c2a9d0 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1740810896 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904040070 con 0x55d440c2a9d0 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1740810896 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8900010ac0 con 0x55d440c2a9d0 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f891784d740 10 client.15342 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f891784d740 10 client.15342 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f891784d740 20 client.15342 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f891784d740 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440c4aa90 0x55d440c4bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f891784d740 4 client.15342 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d440b9e600 con 0x55d440c4aa90 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f890e7fc640 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440c4aa90 0x55d440c4bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f88f2ff5640 10 client.15342 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.539+0000 7f890e7fc640 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440c4aa90 0x55d440c4bf00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77bd8dba9c532a7a server_cookie=d35e03a5350e27a4 in_seq=0 out_seq=0 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1740810896 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d440b9e600 con 0x55d440c4aa90 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f88f2ff5640 10 client.15342 handle_command_reply: tid=0 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 client.15342 shutdown 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2a9d0 msgr2=0x55d440c353c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2a9d0 0x55d440c353c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8900018500 tx=0x7f890006ac60 comp rx=0 tx=0).stop 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 shutdown_connections 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440c4aa90 0x55d440c4bf00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c35bb0 0x55d440c32c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c32710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f88f2ff5640 0 client.15342 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:12.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 --2- 172.21.15.100:0/1740810896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2a9d0 0x55d440c353c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 >> 172.21.15.100:0/1740810896 conn(0x55d440c26f60 msgr2=0x55d440c2cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:12.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 shutdown_connections 2024-09-12T02:07:12.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 1 -- 172.21.15.100:0/1740810896 wait complete. 2024-09-12T02:07:12.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.540+0000 7f891784d740 20 client.15342 trim_cache size 0 max 16384 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 Processor -- start 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 -- start start 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2b2f0 0x55d440c326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c35bb0 0x55d440c32c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d440c4a240 con 0x55d440c2b2f0 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d440c4a910 con 0x55d440c2a9d0 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f891784d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d440c4afe0 con 0x55d440c35bb0 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2b2f0 0x55d440c326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2b2f0 0x55d440c326d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41054/0 (socket says 172.21.15.100:41054) 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 -- 172.21.15.100:0/3980121605 learned_addr learned my addr 172.21.15.100:0/3980121605 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890effd640 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890f7fe640 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c35bb0 0x55d440c32c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 -- 172.21.15.100:0/3980121605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c35bb0 msgr2=0x55d440c32c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c35bb0 0x55d440c32c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 -- 172.21.15.100:0/3980121605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 msgr2=0x55d440c4bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 -- 172.21.15.100:0/3980121605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440c26d90 con 0x55d440c2b2f0 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890effd640 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.558+0000 7f890e7fc640 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2b2f0 0x55d440c326d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f89040314e0 tx=0x7f890403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6f8e318c04cd7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f88f4ff9640 1 -- 172.21.15.100:0/3980121605 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904035040 con 0x55d440c2b2f0 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f88f4ff9640 1 -- 172.21.15.100:0/3980121605 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904040070 con 0x55d440c2b2f0 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f88f4ff9640 1 -- 172.21.15.100:0/3980121605 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040035f0 con 0x55d440c2b2f0 2024-09-12T02:07:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 -- 172.21.15.100:0/3980121605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2b2f0 msgr2=0x55d440c326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2b2f0 0x55d440c326d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f89040314e0 tx=0x7f890403e040 comp rx=0 tx=0).stop 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 -- 172.21.15.100:0/3980121605 shutdown_connections 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c35bb0 0x55d440c32c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c2b2f0 0x55d440c326d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 --2- 172.21.15.100:0/3980121605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 -- 172.21.15.100:0/3980121605 >> 172.21.15.100:0/3980121605 conn(0x55d440c26f60 msgr2=0x55d440c27340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 -- 172.21.15.100:0/3980121605 shutdown_connections 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.559+0000 7f891784d740 1 -- 172.21.15.100:0/3980121605 wait complete. 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 -- start start 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 Processor -- start 2024-09-12T02:07:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c4db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440cb3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d440c4bd80 con 0x55d440c35bb0 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d440c4b6b0 con 0x55d440c2a9d0 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d440c4c450 con 0x55d440c2b2f0 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f891784d740 10 client.0 _ll_register_callbacks cb 0x7f8900009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440cb3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c4db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440cb3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41070/0 (socket says 172.21.15.100:41070) 2024-09-12T02:07:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 -- 172.21.15.100:0/1714123834 learned_addr learned my addr 172.21.15.100:0/1714123834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890effd640 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 -- 172.21.15.100:0/1714123834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 msgr2=0x55d440c4db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c4db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 -- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 msgr2=0x55d440c4d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890f7fe640 1 -- 172.21.15.100:0/1714123834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440cb36d0 con 0x55d440c35bb0 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.560+0000 7f890effd640 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f890f7fe640 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440cb3190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8908017e50 tx=0x7f8908004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4873a864209b29d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f88f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1714123834 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890802c060 con 0x55d440c35bb0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1714123834 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8908027640 con 0x55d440c35bb0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8904040070 con 0x55d440c35bb0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1714123834 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8908014040 con 0x55d440c35bb0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 10 client.15348 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d440cb48c0 con 0x55d440c35bb0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1714123834 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904040070 con 0x55d440c35bb0 2024-09-12T02:07:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1714123834 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8908032890 con 0x55d440c35bb0 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 10 client.15348 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 10 client.15348 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 20 client.15348 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440cb9520 0x55d440cb8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 4 client.15348 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.561+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "status"}) -- 0x55d440b98b10 con 0x55d440cb9520 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f890effd640 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440cb9520 0x55d440cb8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f890effd640 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440cb9520 0x55d440cb8230 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e9250fa35bbf8ec server_cookie=83befa194f3168e8 in_seq=0 out_seq=0 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f88f2ff5640 10 client.15348 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f88f2ff5640 1 -- 172.21.15.100:0/1714123834 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d440b98b10 con 0x55d440cb9520 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f88f2ff5640 10 client.15348 handle_command_reply: tid=0 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 client.15348 shutdown 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 msgr2=0x55d440cb3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440cb3190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8908017e50 tx=0x7f8908004b50 comp rx=0 tx=0).stop 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 shutdown_connections 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d440cb9520 0x55d440cb8230 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d440c35bb0 0x55d440cb3190 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d440c2b2f0 0x55d440c4db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f88f2ff5640 0 client.15348 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 --2- 172.21.15.100:0/1714123834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d440c2a9d0 0x55d440c4d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 >> 172.21.15.100:0/1714123834 conn(0x55d440c26f60 msgr2=0x55d440c27340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 shutdown_connections 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 1 -- 172.21.15.100:0/1714123834 wait complete. 2024-09-12T02:07:12.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.562+0000 7f891784d740 20 client.15348 trim_cache size 0 max 16384 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "3a2902f2-70aa-11ef-bcea-c7b262605968", 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24452, 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 124.52074401599999, 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 24, 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 82, 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 135.58523413699999 2024-09-12T02:07:12.577 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:12.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f88f80a2c10 msgr2=0x7f88f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f88f80a2c10 0x7f88f80a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8908009900 tx=0x7f8908009650 comp rx=0 tx=0).stop 2024-09-12T02:07:12.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910100e20 msgr2=0x7f8910198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:12.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910100e20 0x7f8910198540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f890000e9f0 tx=0x7f890000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 shutdown_connections 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f88f80a2c10 0x7f88f80a50d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8910102ef0 0x7f891019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8910102570 0x7f8910198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 --2- 172.21.15.100:0/1032402113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8910100e20 0x7f8910198540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 >> 172.21.15.100:0/1032402113 conn(0x7f89100fc7d0 msgr2=0x7f8910069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 shutdown_connections 2024-09-12T02:07:12.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:12.563+0000 7f8915474640 1 -- 172.21.15.100:0/1032402113 wait complete. 2024-09-12T02:07:12.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:12 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:12 smithi100 ceph-mon[31179]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-12T02:07:12.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:12 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:12 smithi189 ceph-mon[35188]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-12T02:07:12.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.900 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:12 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:12.901 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:12 smithi117 ceph-mon[35240]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-12T02:07:13.259 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T02:07:15.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:14 smithi100 ceph-mon[31179]: pgmap v338: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-12T02:07:15.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:15.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:15.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:14 smithi189 ceph-mon[35188]: pgmap v338: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-12T02:07:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:07:15.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:14 smithi117 ceph-mon[35240]: pgmap v338: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-12T02:07:17.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:17 smithi117 ceph-mon[35240]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-12T02:07:17.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:17 smithi100 ceph-mon[31179]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-12T02:07:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:17 smithi189 ceph-mon[35188]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-12T02:07:19.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:19 smithi117 ceph-mon[35240]: pgmap v340: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-12T02:07:19.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:19 smithi100 ceph-mon[31179]: pgmap v340: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-12T02:07:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:19 smithi189 ceph-mon[35188]: pgmap v340: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-12T02:07:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 -- 172.21.15.100:0/404881320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee4101c30 msgr2=0x7f4ee41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 --2- 172.21.15.100:0/404881320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee4101c30 0x7f4ee41020b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009900 tx=0x7f4ed802a410 comp rx=0 tx=0).stop 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 -- 172.21.15.100:0/404881320 shutdown_connections 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 --2- 172.21.15.100:0/404881320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee41025f0 0x7f4ee4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 --2- 172.21.15.100:0/404881320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee4101c30 0x7f4ee41020b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 --2- 172.21.15.100:0/404881320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ee4100a40 0x7f4ee4100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 -- 172.21.15.100:0/404881320 >> 172.21.15.100:0/404881320 conn(0x7f4ee40fc1e0 msgr2=0x7f4ee40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 -- 172.21.15.100:0/404881320 shutdown_connections 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.759+0000 7f4eea865640 1 -- 172.21.15.100:0/404881320 wait complete. 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 Processor -- start 2024-09-12T02:07:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 -- start start 2024-09-12T02:07:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ee4100a40 0x7f4ee4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee4101c30 0x7f4ee419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee41025f0 0x7f4ee41a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee410c6a0 con 0x7f4ee4101c30 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee410c520 con 0x7f4ee41025f0 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4eea865640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee410c820 con 0x7f4ee4100a40 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee4101c30 0x7f4ee419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee4101c30 0x7f4ee419a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34760/0 (socket says 172.21.15.100:34760) 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.760+0000 7f4ee37fe640 1 -- 172.21.15.100:0/2165780396 learned_addr learned my addr 172.21.15.100:0/2165780396 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee41025f0 0x7f4ee41a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ee4100a40 0x7f4ee4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee37fe640 1 -- 172.21.15.100:0/2165780396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ee4100a40 msgr2=0x7f4ee4199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ee4100a40 0x7f4ee4199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee37fe640 1 -- 172.21.15.100:0/2165780396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee41025f0 msgr2=0x7f4ee41a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee41025f0 0x7f4ee41a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee37fe640 1 -- 172.21.15.100:0/2165780396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee41a1c10 con 0x7f4ee4101c30 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee41025f0 0x7f4ee41a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee4101c30 0x7f4ee419a530 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009230 tx=0x7f4ed8031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee17fa640 1 -- 172.21.15.100:0/2165780396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed803f030 con 0x7f4ee4101c30 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee17fa640 1 -- 172.21.15.100:0/2165780396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed8003ad0 con 0x7f4ee4101c30 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee41a1ea0 con 0x7f4ee4101c30 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4ee17fa640 1 -- 172.21.15.100:0/2165780396 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8035070 con 0x7f4ee4101c30 2024-09-12T02:07:19.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.761+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee41a2300 con 0x7f4ee4101c30 2024-09-12T02:07:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 Processor -- start 2024-09-12T02:07:19.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 -- start start 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4ee17fa640 1 -- 172.21.15.100:0/2165780396 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4ed8042030 con 0x7f4ee4101c30 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cde9a0 0x55d272cdeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272ce3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272ce4370 0x55d272ce6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d272c422f0 con 0x55d272cdf2e0 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d272bea270 con 0x55d272ce4370 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.764+0000 7f4eed606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d272c3e2b0 con 0x55d272cde9a0 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272ce3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee8e02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cde9a0 0x55d272cdeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272ce3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34774/0 (socket says 172.21.15.100:34774) 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee3fff640 1 -- 172.21.15.100:0/4212888493 learned_addr learned my addr 172.21.15.100:0/4212888493 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:19.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272ce4370 0x55d272ce6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee8e02640 1 -- 172.21.15.100:0/4212888493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272ce4370 msgr2=0x55d272ce6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272ce4370 0x55d272ce6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee8e02640 1 -- 172.21.15.100:0/4212888493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 msgr2=0x55d272ce3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272ce3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee8e02640 1 -- 172.21.15.100:0/4212888493 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d272be9340 con 0x55d272cde9a0 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272ce3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee17fa640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4ecc0a2cd0 0x7f4ecc0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4ecc0a2cd0 0x7f4ecc0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cde9a0 0x55d272cdeda0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009f10 tx=0x7f4edc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a6a69a676d51727 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4ee17fa640 1 -- 172.21.15.100:0/2165780396 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4ed80ef800 con 0x7f4ee4101c30 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.765+0000 7f4eca7fc640 1 -- 172.21.15.100:0/4212888493 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc011640 con 0x55d272cde9a0 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eca7fc640 1 -- 172.21.15.100:0/4212888493 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4edc015070 con 0x55d272cde9a0 2024-09-12T02:07:19.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eca7fc640 1 -- 172.21.15.100:0/4212888493 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc01bc60 con 0x55d272cde9a0 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 -- 172.21.15.100:0/4212888493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cde9a0 msgr2=0x55d272cdeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4ecc0a2cd0 0x7f4ecc0a5190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55d272cdfd10 tx=0x7f4ed400b600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cde9a0 0x55d272cdeda0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009f10 tx=0x7f4edc0107a0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 -- 172.21.15.100:0/4212888493 shutdown_connections 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272ce4370 0x55d272ce6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272ce3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 --2- 172.21.15.100:0/4212888493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cde9a0 0x55d272cdeda0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 -- 172.21.15.100:0/4212888493 >> 172.21.15.100:0/4212888493 conn(0x55d272cda010 msgr2=0x55d272cda410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 -- 172.21.15.100:0/4212888493 shutdown_connections 2024-09-12T02:07:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.766+0000 7f4eed606740 1 -- 172.21.15.100:0/4212888493 wait complete. 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 -- start start 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 Processor -- start 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ce8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cdf2e0 0x55d272ce9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272ce4370 0x55d272cf0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d272ce7340 con 0x55d272ce4370 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d272bcb290 con 0x55d272cde9a0 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d272ce74c0 con 0x55d272cdf2e0 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4eed606740 10 client.0 _ll_register_callbacks cb 0x55d272bfc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4ee8e02640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272ce4370 0x55d272cf0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4ee8e02640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272ce4370 0x55d272cf0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34786/0 (socket says 172.21.15.100:34786) 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.767+0000 7f4ee8e02640 1 -- 172.21.15.100:0/3894149011 learned_addr learned my addr 172.21.15.100:0/3894149011 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ce8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cdf2e0 0x55d272ce9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee8e02640 1 -- 172.21.15.100:0/3894149011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cdf2e0 msgr2=0x55d272ce9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cdf2e0 0x55d272ce9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee8e02640 1 -- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 msgr2=0x55d272ce8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ce8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee8e02640 1 -- 172.21.15.100:0/3894149011 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d272955210 con 0x55d272ce4370 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272ce4370 0x55d272cf0110 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4edc011010 tx=0x7f4edc004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3168017e80d4e00b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ec37fe640 1 -- 172.21.15.100:0/3894149011 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc02a060 con 0x55d272ce4370 2024-09-12T02:07:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ec37fe640 1 -- 172.21.15.100:0/3894149011 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4edc01bbf0 con 0x55d272ce4370 2024-09-12T02:07:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4edc015070 con 0x55d272ce4370 2024-09-12T02:07:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ec37fe640 1 -- 172.21.15.100:0/3894149011 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4edc01bdf0 con 0x55d272ce4370 2024-09-12T02:07:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4eed606740 10 client.15360 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d272a21620 con 0x55d272ce4370 2024-09-12T02:07:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.768+0000 7f4ec37fe640 1 -- 172.21.15.100:0/3894149011 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4edc015070 con 0x55d272ce4370 2024-09-12T02:07:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4ec37fe640 1 -- 172.21.15.100:0/3894149011 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4edc0114d0 con 0x55d272ce4370 2024-09-12T02:07:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4eed606740 10 client.15360 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4eed606740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4eed606740 20 client.15360 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4eed606740 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272cf4520 0x55d272cf6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4eed606740 4 client.15360 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d272c4fa20 con 0x55d272cf4520 2024-09-12T02:07:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272cf4520 0x55d272cf6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4ec37fe640 10 client.15360 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.769+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272cf4520 0x55d272cf6910 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a05f168f040a6407 server_cookie=636a82d23dbcf4ec in_seq=0 out_seq=0 2024-09-12T02:07:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4ec37fe640 1 -- 172.21.15.100:0/3894149011 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d272c4fa20 con 0x55d272cf4520 2024-09-12T02:07:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4ec37fe640 10 client.15360 handle_command_reply: tid=0 2024-09-12T02:07:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 client.15360 shutdown 2024-09-12T02:07:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272ce4370 msgr2=0x55d272cf0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272ce4370 0x55d272cf0110 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4edc011010 tx=0x7f4edc004c70 comp rx=0 tx=0).stop 2024-09-12T02:07:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 shutdown_connections 2024-09-12T02:07:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272cf4520 0x55d272cf6910 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272ce4370 0x55d272cf0110 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272cdf2e0 0x55d272ce9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 --2- 172.21.15.100:0/3894149011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ce8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4ec37fe640 0 client.15360 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 >> 172.21.15.100:0/3894149011 conn(0x55d272cda010 msgr2=0x55d272cdb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.770+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 shutdown_connections 2024-09-12T02:07:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.771+0000 7f4eed606740 1 -- 172.21.15.100:0/3894149011 wait complete. 2024-09-12T02:07:19.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.771+0000 7f4eed606740 20 client.15360 trim_cache size 0 max 16384 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 Processor -- start 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 -- start start 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cde9a0 0x55d272cdaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cdf2e0 0x55d272cf00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 0x55d272cdb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41ada70 con 0x55d272cde9a0 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41ab340 con 0x55d272cdf2e0 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4eed606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41a9190 con 0x55d272ce4370 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cde9a0 0x55d272cdaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cde9a0 0x55d272cdaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34802/0 (socket says 172.21.15.100:34802) 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 -- 172.21.15.100:0/235586912 learned_addr learned my addr 172.21.15.100:0/235586912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 -- 172.21.15.100:0/235586912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 msgr2=0x55d272cdb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/235586912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 0x55d272cdb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 -- 172.21.15.100:0/235586912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cdf2e0 msgr2=0x55d272cf00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/235586912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cdf2e0 0x55d272cf00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 -- 172.21.15.100:0/235586912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d272cf6c80 con 0x55d272cde9a0 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.785+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/235586912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cde9a0 0x55d272cdaec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4005fd0 tx=0x7f4ed4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82123455ea0d322d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4ec9ffb640 1 -- 172.21.15.100:0/235586912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4010d30 con 0x55d272cde9a0 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4ec9ffb640 1 -- 172.21.15.100:0/235586912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed40277b0 con 0x55d272cde9a0 2024-09-12T02:07:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4ec9ffb640 1 -- 172.21.15.100:0/235586912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed401e8d0 con 0x55d272cde9a0 2024-09-12T02:07:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 -- 172.21.15.100:0/235586912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cde9a0 msgr2=0x55d272cdaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 --2- 172.21.15.100:0/235586912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cde9a0 0x55d272cdaec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4005fd0 tx=0x7f4ed4015000 comp rx=0 tx=0).stop 2024-09-12T02:07:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 -- 172.21.15.100:0/235586912 shutdown_connections 2024-09-12T02:07:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 --2- 172.21.15.100:0/235586912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 0x55d272cdb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 --2- 172.21.15.100:0/235586912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cdf2e0 0x55d272cf00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 --2- 172.21.15.100:0/235586912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cde9a0 0x55d272cdaec0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 -- 172.21.15.100:0/235586912 >> 172.21.15.100:0/235586912 conn(0x55d272cda010 msgr2=0x55d272ce8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 -- 172.21.15.100:0/235586912 shutdown_connections 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.786+0000 7f4eed606740 1 -- 172.21.15.100:0/235586912 wait complete. 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 -- start start 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 Processor -- start 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ceda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272cedf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 0x55d272ceef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41a9800 con 0x55d272cdf2e0 2024-09-12T02:07:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41aac70 con 0x55d272cde9a0 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41a9ed0 con 0x55d272ce4370 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4eed606740 10 client.0 _ll_register_callbacks cb 0x7f4ed400b4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272cedf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272cedf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34806/0 (socket says 172.21.15.100:34806) 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 -- 172.21.15.100:0/28048307 learned_addr learned my addr 172.21.15.100:0/28048307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ceda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee8e02640 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 0x55d272ceef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 -- 172.21.15.100:0/28048307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 msgr2=0x55d272ceef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 0x55d272ceef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 -- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 msgr2=0x55d272ceda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ceda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.787+0000 7f4ee37fe640 1 -- 172.21.15.100:0/28048307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d272cef510 con 0x55d272cdf2e0 2024-09-12T02:07:19.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4ee37fe640 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272cedf40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b8370 tx=0x7f4ed802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a8da54209f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4ec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4ec37fe640 1 -- 172.21.15.100:0/28048307 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8049070 con 0x55d272cdf2e0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4ec37fe640 1 -- 172.21.15.100:0/28048307 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4ed80b8580 con 0x55d272cdf2e0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed40277b0 con 0x55d272cdf2e0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4ec37fe640 1 -- 172.21.15.100:0/28048307 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ed80bbce0 con 0x55d272cdf2e0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 10 client.15366 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d272d5f430 con 0x55d272cdf2e0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4ec37fe640 1 -- 172.21.15.100:0/28048307 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed40277b0 con 0x55d272cdf2e0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4ec37fe640 1 -- 172.21.15.100:0/28048307 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4ed8003c80 con 0x55d272cdf2e0 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 10 client.15366 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 10 client.15366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 20 client.15366 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272d5fde0 0x55d272d62200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 4 client.15366 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:07:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.788+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d272c49d70 con 0x55d272d5fde0 2024-09-12T02:07:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.789+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272d5fde0 0x55d272d62200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.789+0000 7f4ec37fe640 10 client.15366 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.789+0000 7f4ee3fff640 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272d5fde0 0x55d272d62200 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49e2bb1fe14cc9a3 server_cookie=d635b6c0680ec15c in_seq=0 out_seq=0 2024-09-12T02:07:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4ec37fe640 1 -- 172.21.15.100:0/28048307 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d272c49d70 con 0x55d272d5fde0 2024-09-12T02:07:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4ec37fe640 10 client.15366 handle_command_reply: tid=0 2024-09-12T02:07:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 client.15366 shutdown 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 msgr2=0x55d272cedf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272cedf40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b8370 tx=0x7f4ed802a410 comp rx=0 tx=0).stop 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 shutdown_connections 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55d272d5fde0 0x55d272d62200 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d272ce4370 0x55d272ceef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d272cdf2e0 0x55d272cedf40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4ec37fe640 0 client.15366 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 --2- 172.21.15.100:0/28048307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d272cde9a0 0x55d272ceda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 >> 172.21.15.100:0/28048307 conn(0x55d272cda010 msgr2=0x55d272cd89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 shutdown_connections 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 1 -- 172.21.15.100:0/28048307 wait complete. 2024-09-12T02:07:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.798+0000 7f4eed606740 20 client.15366 trim_cache size 0 max 16384 2024-09-12T02:07:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-09-12T02:07:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-09-12T02:07:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-09-12T02:07:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4ecc0a2cd0 msgr2=0x7f4ecc0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4ecc0a2cd0 0x7f4ecc0a5190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55d272cdfd10 tx=0x7f4ed400b600 comp rx=0 tx=0).stop 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee4101c30 msgr2=0x7f4ee419a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee4101c30 0x7f4ee419a530 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009230 tx=0x7f4ed8031b60 comp rx=0 tx=0).stop 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 shutdown_connections 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4ecc0a2cd0 0x7f4ecc0a5190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee41025f0 0x7f4ee41a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee4101c30 0x7f4ee419a530 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 --2- 172.21.15.100:0/2165780396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ee4100a40 0x7f4ee4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:19.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 >> 172.21.15.100:0/2165780396 conn(0x7f4ee40fc1e0 msgr2=0x7f4ee40fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:19.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 shutdown_connections 2024-09-12T02:07:19.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:19.799+0000 7f4eea865640 1 -- 172.21.15.100:0/2165780396 wait complete. 2024-09-12T02:07:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:21 smithi117 ceph-mon[35240]: pgmap v341: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-12T02:07:21.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:21 smithi100 ceph-mon[31179]: pgmap v341: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-12T02:07:21.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:21 smithi189 ceph-mon[35188]: pgmap v341: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-12T02:07:23.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:22 smithi100 ceph-mon[31179]: pgmap v342: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:07:23.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:22 smithi189 ceph-mon[35188]: pgmap v342: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:07:23.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:22 smithi117 ceph-mon[35240]: pgmap v342: 97 pgs: 97 active+clean; 655 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:07:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:25 smithi117 ceph-mon[35240]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:07:25.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:25 smithi100 ceph-mon[31179]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:07:25.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:25 smithi189 ceph-mon[35188]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:07:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:27 smithi117 ceph-mon[35240]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-12T02:07:27.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:27 smithi100 ceph-mon[31179]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-12T02:07:27.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:27 smithi189 ceph-mon[35188]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-12T02:07:27.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:07:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:28.260 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T02:07:28.261 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:07:28.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 -- 172.21.15.100:0/1959769555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 msgr2=0x7f761c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 --2- 172.21.15.100:0/1959769555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c1029b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7610009900 tx=0x7f761002a480 comp rx=0 tx=0).stop 2024-09-12T02:07:28.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 -- 172.21.15.100:0/1959769555 shutdown_connections 2024-09-12T02:07:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 --2- 172.21.15.100:0/1959769555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f761c102ef0 0x7f761c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 --2- 172.21.15.100:0/1959769555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c1029b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 --2- 172.21.15.100:0/1959769555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f761c100e20 0x7f761c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 -- 172.21.15.100:0/1959769555 >> 172.21.15.100:0/1959769555 conn(0x7f761c0fc7d0 msgr2=0x7f761c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 -- 172.21.15.100:0/1959769555 shutdown_connections 2024-09-12T02:07:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 -- 172.21.15.100:0/1959769555 wait complete. 2024-09-12T02:07:28.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.617+0000 7f7620f4f640 1 Processor -- start 2024-09-12T02:07:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7620f4f640 1 -- start start 2024-09-12T02:07:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7620f4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f761c100e20 0x7f761c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7620f4f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7620f4f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f761c102ef0 0x7f761c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7620f4f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f761c110f50 con 0x7f761c102570 2024-09-12T02:07:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7620f4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f761c110dd0 con 0x7f761c100e20 2024-09-12T02:07:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7620f4f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1110d0 con 0x7f761c102ef0 2024-09-12T02:07:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43502/0 (socket says 172.21.15.100:43502) 2024-09-12T02:07:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 -- 172.21.15.100:0/3650103856 learned_addr learned my addr 172.21.15.100:0/3650103856 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f761a59c640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f761c100e20 0x7f761c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f761ad9d640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f761c102ef0 0x7f761c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 -- 172.21.15.100:0/3650103856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f761c102ef0 msgr2=0x7f761c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f761c102ef0 0x7f761c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 -- 172.21.15.100:0/3650103856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f761c100e20 msgr2=0x7f761c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f761c100e20 0x7f761c198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 -- 172.21.15.100:0/3650103856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c19d500 con 0x7f761c102570 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f761ad9d640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f761c102ef0 0x7f761c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f761a59c640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f761c100e20 0x7f761c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.618+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c198a90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7610006010 tx=0x7f7610003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.619+0000 7f760b7fe640 1 -- 172.21.15.100:0/3650103856 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761003f070 con 0x7f761c102570 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.619+0000 7f760b7fe640 1 -- 172.21.15.100:0/3650103856 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7610031c30 con 0x7f761c102570 2024-09-12T02:07:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.619+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761c19d790 con 0x7f761c102570 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.619+0000 7f760b7fe640 1 -- 172.21.15.100:0/3650103856 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610035030 con 0x7f761c102570 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.620+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761c1a50d0 con 0x7f761c102570 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.621+0000 7f760b7fe640 1 -- 172.21.15.100:0/3650103856 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7610042070 con 0x7f761c102570 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.622+0000 7f760b7fe640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f76040a2c90 0x7f76040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.622+0000 7f760b7fe640 1 -- 172.21.15.100:0/3650103856 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76100ef6d0 con 0x7f761c102570 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.622+0000 7f761a59c640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f76040a2c90 0x7f76040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.622+0000 7f7623328740 1 Processor -- start 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.622+0000 7f7623328740 1 -- start start 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.622+0000 7f761a59c640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f76040a2c90 0x7f76040a5150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f760c009fc0 tx=0x7f760c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f7623328740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befcea880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f7623328740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befcf5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f7623328740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcf5680 0x559befcf7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f7623328740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559befc502e0 con 0x559befcea4a0 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f7623328740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559befbf7ce0 con 0x559befcf5680 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f7623328740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559befc4c2a0 con 0x559befceadc0 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befcea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befcea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43518/0 (socket says 172.21.15.100:43518) 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 -- 172.21.15.100:0/1870446602 learned_addr learned my addr 172.21.15.100:0/1870446602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761ad9d640 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcf5680 0x559befcf7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f7619d9b640 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befcf5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 -- 172.21.15.100:0/1870446602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 msgr2=0x559befcf5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befcf5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 -- 172.21.15.100:0/1870446602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcf5680 msgr2=0x559befcf7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcf5680 0x559befcf7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 -- 172.21.15.100:0/1870446602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559befbdc440 con 0x559befcea4a0 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.623+0000 7f761a59c640 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befcea880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f760c0042c0 tx=0x7f760c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0665ab1fe2f422 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7608ff9640 1 -- 172.21.15.100:0/1870446602 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c00f480 con 0x559befcea4a0 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7608ff9640 1 -- 172.21.15.100:0/1870446602 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f760c00fb00 con 0x559befcea4a0 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7608ff9640 1 -- 172.21.15.100:0/1870446602 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c01cc40 con 0x559befcea4a0 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7623328740 1 -- 172.21.15.100:0/1870446602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 msgr2=0x559befcea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7623328740 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befcea880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f760c0042c0 tx=0x7f760c014000 comp rx=0 tx=0).stop 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7623328740 1 -- 172.21.15.100:0/1870446602 shutdown_connections 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7623328740 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcf5680 0x559befcf7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7623328740 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befcf5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7623328740 1 --2- 172.21.15.100:0/1870446602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befcea880 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.624+0000 7f7623328740 1 -- 172.21.15.100:0/1870446602 >> 172.21.15.100:0/1870446602 conn(0x559befce6a30 msgr2=0x559befce6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 -- 172.21.15.100:0/1870446602 shutdown_connections 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 -- 172.21.15.100:0/1870446602 wait complete. 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 -- start start 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 Processor -- start 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcf4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcf21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befcf5680 0x559befcf2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559befcf8250 con 0x559befceadc0 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559befc0b050 con 0x559befcea4a0 2024-09-12T02:07:28.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559befcf83d0 con 0x559befcf5680 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7623328740 10 client.0 _ll_register_callbacks cb 0x559befc4b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcf21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcf21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43528/0 (socket says 172.21.15.100:43528) 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.625+0000 7f7619d9b640 1 -- 172.21.15.100:0/3954815426 learned_addr learned my addr 172.21.15.100:0/3954815426 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f761a59c640 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcf4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f761ad9d640 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befcf5680 0x559befcf2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7619d9b640 1 -- 172.21.15.100:0/3954815426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befcf5680 msgr2=0x559befcf2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befcf5680 0x559befcf2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7619d9b640 1 -- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 msgr2=0x559befcf4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcf4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7619d9b640 1 -- 172.21.15.100:0/3954815426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bef9c13c0 con 0x559befceadc0 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcf21e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f76100ed0c0 tx=0x7f76100bc5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0db955f3cec72d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7601ffb640 1 -- 172.21.15.100:0/3954815426 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100bf070 con 0x559befceadc0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f760c00fb00 con 0x559befceadc0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7601ffb640 1 -- 172.21.15.100:0/3954815426 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76100b8450 con 0x559befceadc0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7601ffb640 1 -- 172.21.15.100:0/3954815426 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7610049040 con 0x559befceadc0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7623328740 10 client.15378 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559befd07f70 con 0x559befceadc0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.626+0000 7f7601ffb640 1 -- 172.21.15.100:0/3954815426 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f760c00fb00 con 0x559befceadc0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f7601ffb640 1 -- 172.21.15.100:0/3954815426 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f76100bb230 con 0x559befceadc0 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f7623328740 10 client.15378 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f7623328740 10 client.15378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f7623328740 20 client.15378 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f7623328740 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befd09360 0x559befd0b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f7623328740 4 client.15378 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559befc5d850 con 0x559befd09360 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.627+0000 7f761a59c640 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befd09360 0x559befd0b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f761a59c640 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befd09360 0x559befd0b7b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14df5c0754a8c7bb server_cookie=435eca8afb0cf8e2 in_seq=0 out_seq=0 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7601ffb640 10 client.15378 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7601ffb640 1 -- 172.21.15.100:0/3954815426 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559befc5d850 con 0x559befd09360 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7601ffb640 10 client.15378 handle_command_reply: tid=0 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 client.15378 shutdown 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 msgr2=0x559befcf21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcf21e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f76100ed0c0 tx=0x7f76100bc5a0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 shutdown_connections 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befd09360 0x559befd0b7b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befcf5680 0x559befcf2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcf21e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 --2- 172.21.15.100:0/3954815426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcf4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7601ffb640 0 client.15378 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.628+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 >> 172.21.15.100:0/3954815426 conn(0x559befce6a30 msgr2=0x559befcec710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.629+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 shutdown_connections 2024-09-12T02:07:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.629+0000 7f7623328740 1 -- 172.21.15.100:0/3954815426 wait complete. 2024-09-12T02:07:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.629+0000 7f7623328740 20 client.15378 trim_cache size 0 max 16384 2024-09-12T02:07:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 Processor -- start 2024-09-12T02:07:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 -- start start 2024-09-12T02:07:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befce6a30 0x559befcf4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befd11050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befd11590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1adb50 con 0x559befcea4a0 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1ab420 con 0x559befce6a30 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7623328740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1a9290 con 0x559befceadc0 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befd11050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befd11050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43540/0 (socket says 172.21.15.100:43540) 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.647+0000 7f7619d9b640 1 -- 172.21.15.100:0/3277725411 learned_addr learned my addr 172.21.15.100:0/3277725411 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f761a59c640 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befce6a30 0x559befcf4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f761ad9d640 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befd11590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7619d9b640 1 -- 172.21.15.100:0/3277725411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 msgr2=0x559befd11590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befd11590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7619d9b640 1 -- 172.21.15.100:0/3277725411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befce6a30 msgr2=0x559befcf4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befce6a30 0x559befcf4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7619d9b640 1 -- 172.21.15.100:0/3277725411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559befce7ae0 con 0x559befcea4a0 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f761ad9d640 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befd11590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7619d9b640 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befd11050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f76100dc050 tx=0x7f761003b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14da8378d8714305 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7603fff640 1 -- 172.21.15.100:0/3277725411 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100bf070 con 0x559befcea4a0 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7603fff640 1 -- 172.21.15.100:0/3277725411 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76100da020 con 0x559befcea4a0 2024-09-12T02:07:28.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.648+0000 7f7603fff640 1 -- 172.21.15.100:0/3277725411 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100bb230 con 0x559befcea4a0 2024-09-12T02:07:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 -- 172.21.15.100:0/3277725411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 msgr2=0x559befd11050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befd11050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f76100dc050 tx=0x7f761003b790 comp rx=0 tx=0).stop 2024-09-12T02:07:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 -- 172.21.15.100:0/3277725411 shutdown_connections 2024-09-12T02:07:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befceadc0 0x559befd11590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befcea4a0 0x559befd11050 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 --2- 172.21.15.100:0/3277725411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befce6a30 0x559befcf4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 -- 172.21.15.100:0/3277725411 >> 172.21.15.100:0/3277725411 conn(0x559befcf2880 msgr2=0x559befcf3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 -- 172.21.15.100:0/3277725411 shutdown_connections 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 -- 172.21.15.100:0/3277725411 wait complete. 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.649+0000 7f7623328740 1 -- start start 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 1 Processor -- start 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befce6a30 0x559befcfde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcfb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcfb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1a98e0 con 0x559befceadc0 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1aad50 con 0x559befcea4a0 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1a9fb0 con 0x559befce6a30 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.650+0000 7f7623328740 10 client.0 _ll_register_callbacks cb 0x7f76100bb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befce6a30 0x559befcfde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcfb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcfb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befce6a30 0x559befcfde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:40630/0 (socket says 172.21.15.100:40630) 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcfb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:43874/0 (socket says 172.21.15.100:43874) 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 -- 172.21.15.100:0/2005415075 learned_addr learned my addr 172.21.15.100:0/2005415075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 -- 172.21.15.100:0/2005415075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 msgr2=0x559befcfb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcfb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 -- 172.21.15.100:0/2005415075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 msgr2=0x559befcfb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcfb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 -- 172.21.15.100:0/2005415075 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559befce76c0 con 0x559befce6a30 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f761a59c640 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befce6a30 0x559befcfde20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f760c0044d0 tx=0x7f760c003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=922047a642014b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.651+0000 7f7601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7601ffb640 1 -- 172.21.15.100:0/2005415075 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c01c5a0 con 0x559befce6a30 2024-09-12T02:07:28.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7601ffb640 1 -- 172.21.15.100:0/2005415075 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f760c005040 con 0x559befce6a30 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76100da020 con 0x559befce6a30 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7601ffb640 1 -- 172.21.15.100:0/2005415075 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f760c005240 con 0x559befce6a30 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 10 client.24865 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559befd73f70 con 0x559befce6a30 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7601ffb640 1 -- 172.21.15.100:0/2005415075 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76100da020 con 0x559befce6a30 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7601ffb640 1 -- 172.21.15.100:0/2005415075 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f760c01a070 con 0x559befce6a30 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 10 client.24865 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 10 client.24865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 20 client.24865 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befcf5680 0x559befd763d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 4 client.24865 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.652+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559befc57d60 con 0x559befcf5680 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7619d9b640 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befcf5680 0x559befd763d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:28.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7601ffb640 10 client.24865 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7619d9b640 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befcf5680 0x559befd763d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216189168f590b4 server_cookie=692331eae6b96305 in_seq=0 out_seq=0 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7601ffb640 1 -- 172.21.15.100:0/2005415075 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559befc57d60 con 0x559befcf5680 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7601ffb640 10 client.24865 handle_command_reply: tid=0 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7623328740 1 client.24865 shutdown 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befce6a30 msgr2=0x559befcfde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.653+0000 7f7623328740 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befce6a30 0x559befcfde20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f760c0044d0 tx=0x7f760c003f10 comp rx=0 tx=0).stop 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 shutdown_connections 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x559befcf5680 0x559befd763d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559befceadc0 0x559befcfb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7601ffb640 0 client.24865 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559befcea4a0 0x559befcfb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 --2- 172.21.15.100:0/2005415075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559befce6a30 0x559befcfde20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 >> 172.21.15.100:0/2005415075 conn(0x559befcf2880 msgr2=0x559befcf4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 shutdown_connections 2024-09-12T02:07:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 1 -- 172.21.15.100:0/2005415075 wait complete. 2024-09-12T02:07:28.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.654+0000 7f7623328740 20 client.24865 trim_cache size 0 max 16384 2024-09-12T02:07:28.660 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:07:28.660 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:07:28.660 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f76040a2c90 msgr2=0x7f76040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f76040a2c90 0x7f76040a5150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f760c009fc0 tx=0x7f760c005f90 comp rx=0 tx=0).stop 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 msgr2=0x7f761c198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c198a90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7610006010 tx=0x7f7610003c10 comp rx=0 tx=0).stop 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 shutdown_connections 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f76040a2c90 0x7f76040a5150 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f761c102ef0 0x7f761c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f761c102570 0x7f761c198a90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 --2- 172.21.15.100:0/3650103856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f761c100e20 0x7f761c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:28.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 >> 172.21.15.100:0/3650103856 conn(0x7f761c0fc7d0 msgr2=0x7f761c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 shutdown_connections 2024-09-12T02:07:28.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:28.655+0000 7f7620f4f640 1 -- 172.21.15.100:0/3650103856 wait complete. 2024-09-12T02:07:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:29.249 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:29 smithi100 ceph-mon[31179]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:07:29.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:29 smithi117 ceph-mon[35240]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:07:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:29 smithi189 ceph-mon[35188]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T02:07:29.802 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:07:29.802 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:07:31.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:31 smithi100 ceph-mon[31179]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T02:07:31.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:31 smithi189 ceph-mon[35188]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T02:07:31.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:31 smithi117 ceph-mon[35240]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T02:07:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.889+0000 7f6b81404640 1 -- 172.21.15.100:0/2817005132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c101ac0 msgr2=0x7f6b7c101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.889+0000 7f6b81404640 1 --2- 172.21.15.100:0/2817005132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c101ac0 0x7f6b7c101f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009900 tx=0x7f6b7002a480 comp rx=0 tx=0).stop 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.889+0000 7f6b81404640 1 -- 172.21.15.100:0/2817005132 shutdown_connections 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.889+0000 7f6b81404640 1 --2- 172.21.15.100:0/2817005132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b7c102480 0x7f6b7c108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.889+0000 7f6b81404640 1 --2- 172.21.15.100:0/2817005132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c101ac0 0x7f6b7c101f40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.889+0000 7f6b81404640 1 --2- 172.21.15.100:0/2817005132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7c100db0 0x7f6b7c1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.889+0000 7f6b81404640 1 -- 172.21.15.100:0/2817005132 >> 172.21.15.100:0/2817005132 conn(0x7f6b7c0fb790 msgr2=0x7f6b7c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 -- 172.21.15.100:0/2817005132 shutdown_connections 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 -- 172.21.15.100:0/2817005132 wait complete. 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 Processor -- start 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 -- start start 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c100db0 0x7f6b7c100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7c101ac0 0x7f6b7c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b7c102480 0x7f6b7c1a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c10c510 con 0x7f6b7c100db0 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c10c390 con 0x7f6b7c101ac0 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.890+0000 7f6b81404640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c10c690 con 0x7f6b7c102480 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c100db0 0x7f6b7c100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c100db0 0x7f6b7c100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43566/0 (socket says 172.21.15.100:43566) 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 -- 172.21.15.100:0/195643243 learned_addr learned my addr 172.21.15.100:0/195643243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b7c102480 0x7f6b7c1a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7c101ac0 0x7f6b7c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 -- 172.21.15.100:0/195643243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b7c102480 msgr2=0x7f6b7c1a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b7c102480 0x7f6b7c1a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 -- 172.21.15.100:0/195643243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7c101ac0 msgr2=0x7f6b7c19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7c101ac0 0x7f6b7c19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 -- 172.21.15.100:0/195643243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c1a1a90 con 0x7f6b7c100db0 2024-09-12T02:07:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b7affd640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c100db0 0x7f6b7c100470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c970 tx=0x7f6b6c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b63fff640 1 -- 172.21.15.100:0/195643243 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c007c10 con 0x7f6b7c100db0 2024-09-12T02:07:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c1a1d20 con 0x7f6b7c100db0 2024-09-12T02:07:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b63fff640 1 -- 172.21.15.100:0/195643243 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b6c007db0 con 0x7f6b7c100db0 2024-09-12T02:07:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b63fff640 1 -- 172.21.15.100:0/195643243 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00f8a0 con 0x7f6b7c100db0 2024-09-12T02:07:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.891+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c1a21d0 con 0x7f6b7c100db0 2024-09-12T02:07:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b63fff640 1 -- 172.21.15.100:0/195643243 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6b6c00fa40 con 0x7f6b7c100db0 2024-09-12T02:07:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 Processor -- start 2024-09-12T02:07:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 -- start start 2024-09-12T02:07:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc04bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc050f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc053a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5616fbfaf2f0 con 0x5616fc04bb70 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5616fbf57270 con 0x5616fc051540 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.894+0000 7f6b84278740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616fbfab2b0 con 0x5616fc04c4b0 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc04bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc04bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43568/0 (socket says 172.21.15.100:43568) 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2881507649 learned_addr learned my addr 172.21.15.100:0/2881507649 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc053a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7affd640 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc050f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b63fff640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b640a2c40 0x7f6b640a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b640a2c40 0x7f6b640a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2881507649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 msgr2=0x5616fc050f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc050f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2881507649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 msgr2=0x5616fc053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc053a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2881507649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616fbf56340 con 0x5616fc04bb70 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc053a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b63fff640 1 -- 172.21.15.100:0/195643243 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6b6c0cf440 con 0x7f6b7c100db0 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc04bf70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6b74013a50 tx=0x7f6b74013f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fd969c6d62617a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b617fa640 1 -- 172.21.15.100:0/2881507649 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74013050 con 0x5616fc04bb70 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b617fa640 1 -- 172.21.15.100:0/2881507649 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b74022070 con 0x5616fc04bb70 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b617fa640 1 -- 172.21.15.100:0/2881507649 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740126b0 con 0x5616fc04bb70 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.895+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b640a2c40 0x7f6b640a5100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b74021000 tx=0x7f6b7401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 -- 172.21.15.100:0/2881507649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 msgr2=0x5616fc04bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc04bf70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6b74013a50 tx=0x7f6b74013f10 comp rx=0 tx=0).stop 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 -- 172.21.15.100:0/2881507649 shutdown_connections 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc053a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc050f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 --2- 172.21.15.100:0/2881507649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc04bf70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 -- 172.21.15.100:0/2881507649 >> 172.21.15.100:0/2881507649 conn(0x5616fc0471e0 msgr2=0x5616fc0475e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 -- 172.21.15.100:0/2881507649 shutdown_connections 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 -- 172.21.15.100:0/2881507649 wait complete. 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.896+0000 7f6b84278740 1 -- start start 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 1 Processor -- start 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04bb70 0x5616fc055d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04c4b0 0x5616fc0562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc051540 0x5616fc05d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5616fc054510 con 0x5616fc04c4b0 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5616fbf38290 con 0x5616fc04bb70 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616fc054690 con 0x5616fc051540 2024-09-12T02:07:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b84278740 10 client.0 _ll_register_callbacks cb 0x5616fbf69140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04c4b0 0x5616fc0562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04c4b0 0x5616fc0562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43570/0 (socket says 172.21.15.100:43570) 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/565393253 learned_addr learned my addr 172.21.15.100:0/565393253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7affd640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04bb70 0x5616fc055d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/565393253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc051540 msgr2=0x5616fc05d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc051540 0x5616fc05d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc051540 0x5616fc05d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04bb70 msgr2=0x5616fc055d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04bb70 0x5616fc055d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/565393253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616fbcc2210 con 0x5616fc04c4b0 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7affd640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04bb70 0x5616fc055d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc051540 0x5616fc05d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04c4b0 0x5616fc0562b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6b7002a9a0 tx=0x7f6b70004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f189890ab2e5c66d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.897+0000 7f6b5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b5eff5640 1 -- 172.21.15.100:0/565393253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70035040 con 0x5616fc04c4b0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b5eff5640 1 -- 172.21.15.100:0/565393253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6b700035f0 con 0x5616fc04c4b0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b74022070 con 0x5616fc04c4b0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b5eff5640 1 -- 172.21.15.100:0/565393253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b700319e0 con 0x5616fc04c4b0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 10 client.15396 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616fbd8e620 con 0x5616fc04c4b0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b5eff5640 1 -- 172.21.15.100:0/565393253 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b74022070 con 0x5616fc04c4b0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b5eff5640 1 -- 172.21.15.100:0/565393253 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b7003db00 con 0x5616fc04c4b0 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 10 client.15396 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 10 client.15396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 20 client.15396 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc061a30 0x5616fc063e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 4 client.15396 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.898+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616fbfbca20 con 0x5616fc061a30 2024-09-12T02:07:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.899+0000 7f6b7affd640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc061a30 0x5616fc063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.899+0000 7f6b5eff5640 10 client.15396 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.899+0000 7f6b7affd640 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc061a30 0x5616fc063e60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f4252bb79823e6a server_cookie=5498a80c9220567c in_seq=0 out_seq=0 2024-09-12T02:07:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b5eff5640 1 -- 172.21.15.100:0/565393253 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616fbfbca20 con 0x5616fc061a30 2024-09-12T02:07:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b5eff5640 10 client.15396 handle_command_reply: tid=0 2024-09-12T02:07:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 client.15396 shutdown 2024-09-12T02:07:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04c4b0 msgr2=0x5616fc0562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04c4b0 0x5616fc0562b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6b7002a9a0 tx=0x7f6b70004270 comp rx=0 tx=0).stop 2024-09-12T02:07:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 shutdown_connections 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc061a30 0x5616fc063e60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc051540 0x5616fc05d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04c4b0 0x5616fc0562b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 --2- 172.21.15.100:0/565393253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04bb70 0x5616fc055d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 >> 172.21.15.100:0/565393253 conn(0x5616fc0471e0 msgr2=0x5616fc0489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b5eff5640 0 client.15396 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 shutdown_connections 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 1 -- 172.21.15.100:0/565393253 wait complete. 2024-09-12T02:07:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.900+0000 7f6b84278740 20 client.15396 trim_cache size 0 max 16384 2024-09-12T02:07:32.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 Processor -- start 2024-09-12T02:07:32.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 -- start start 2024-09-12T02:07:32.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc0461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc0466e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc05d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1ad710 con 0x5616fc04bb70 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1aafe0 con 0x5616fc051540 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b84278740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1a8e30 con 0x5616fc04c4b0 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc0461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc0461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43582/0 (socket says 172.21.15.100:43582) 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.914+0000 7f6b7affd640 1 -- 172.21.15.100:0/1216186578 learned_addr learned my addr 172.21.15.100:0/1216186578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc05d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc0466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7affd640 1 -- 172.21.15.100:0/1216186578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 msgr2=0x5616fc0466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7affd640 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc0466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7affd640 1 -- 172.21.15.100:0/1216186578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 msgr2=0x5616fc05d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7affd640 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc05d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7affd640 1 -- 172.21.15.100:0/1216186578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616fc04b6f0 con 0x5616fc04bb70 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b7affd640 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc0461a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c09bb70 tx=0x7f6b6c09bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad84e97dabe975f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b60ff9640 1 -- 172.21.15.100:0/1216186578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0b3070 con 0x5616fc04bb70 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b60ff9640 1 -- 172.21.15.100:0/1216186578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b6c099ee0 con 0x5616fc04bb70 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.915+0000 7f6b60ff9640 1 -- 172.21.15.100:0/1216186578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c086040 con 0x5616fc04bb70 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- 172.21.15.100:0/1216186578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 msgr2=0x5616fc0461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc0461a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c09bb70 tx=0x7f6b6c09bae0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- 172.21.15.100:0/1216186578 shutdown_connections 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc051540 0x5616fc05d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04c4b0 0x5616fc0466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 --2- 172.21.15.100:0/1216186578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc04bb70 0x5616fc0461a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- 172.21.15.100:0/1216186578 >> 172.21.15.100:0/1216186578 conn(0x5616fc0471e0 msgr2=0x5616fc045a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- 172.21.15.100:0/1216186578 shutdown_connections 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- 172.21.15.100:0/1216186578 wait complete. 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- start start 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 Processor -- start 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04bb70 0x5616fc05a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04c4b0 0x5616fc05ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc051540 0x5616fc05bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1a94a0 con 0x5616fc051540 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1aa910 con 0x5616fc04c4b0 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1a9b70 con 0x5616fc04bb70 2024-09-12T02:07:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b84278740 10 client.0 _ll_register_callbacks cb 0x7f6b70009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc051540 0x5616fc05bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc051540 0x5616fc05bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43592/0 (socket says 172.21.15.100:43592) 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.916+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2831493731 learned_addr learned my addr 172.21.15.100:0/2831493731 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7affd640 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04bb70 0x5616fc05a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04c4b0 0x5616fc05ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2831493731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04bb70 msgr2=0x5616fc05a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04bb70 0x5616fc05a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04c4b0 msgr2=0x5616fc05ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04c4b0 0x5616fc05ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7b7fe640 1 -- 172.21.15.100:0/2831493731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616fc05c120 con 0x5616fc051540 2024-09-12T02:07:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b7b7fe640 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc051540 0x5616fc05bb10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6b74007580 tx=0x7f6b74004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662d2c09269906a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b5eff5640 1 -- 172.21.15.100:0/2831493731 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74038060 con 0x5616fc051540 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b5eff5640 1 -- 172.21.15.100:0/2831493731 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6b74011e00 con 0x5616fc051540 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b6c099ee0 con 0x5616fc051540 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b5eff5640 1 -- 172.21.15.100:0/2831493731 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b740079b0 con 0x5616fc051540 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b84278740 10 client.15402 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616fc05d4a0 con 0x5616fc051540 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.917+0000 7f6b5eff5640 1 -- 172.21.15.100:0/2831493731 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b6c099ee0 con 0x5616fc051540 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b5eff5640 1 -- 172.21.15.100:0/2831493731 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b74005240 con 0x5616fc051540 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b84278740 10 client.15402 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b84278740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b84278740 20 client.15402 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b84278740 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc0ccc20 0x5616fc0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b84278740 4 client.15402 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:07:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5616fbfb6d70 con 0x5616fc0ccc20 2024-09-12T02:07:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b7affd640 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc0ccc20 0x5616fc0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b5eff5640 10 client.15402 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.918+0000 7f6b7affd640 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc0ccc20 0x5616fc0cf040 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47b6120e65dff3d9 server_cookie=d89994cbb38cd5a3 in_seq=0 out_seq=0 2024-09-12T02:07:32.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b5eff5640 1 -- 172.21.15.100:0/2831493731 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5616fbfb6d70 con 0x5616fc0ccc20 2024-09-12T02:07:32.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b5eff5640 10 client.15402 handle_command_reply: tid=0 2024-09-12T02:07:32.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 client.15402 shutdown 2024-09-12T02:07:32.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc051540 msgr2=0x5616fc05bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc051540 0x5616fc05bb10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6b74007580 tx=0x7f6b74004c10 comp rx=0 tx=0).stop 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 shutdown_connections 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5616fc0ccc20 0x5616fc0cf040 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616fc051540 0x5616fc05bb10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616fc04c4b0 0x5616fc05ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b5eff5640 0 client.15402 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 --2- 172.21.15.100:0/2831493731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616fc04bb70 0x5616fc05a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 >> 172.21.15.100:0/2831493731 conn(0x5616fc0471e0 msgr2=0x5616fc0462b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 shutdown_connections 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 1 -- 172.21.15.100:0/2831493731 wait complete. 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.922+0000 7f6b84278740 20 client.15402 trim_cache size 0 max 16384 2024-09-12T02:07:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-09-12T02:07:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-09-12T02:07:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-09-12T02:07:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b640a2c40 msgr2=0x7f6b640a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b640a2c40 0x7f6b640a5100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b74021000 tx=0x7f6b7401f000 comp rx=0 tx=0).stop 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c100db0 msgr2=0x7f6b7c100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c100db0 0x7f6b7c100470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c970 tx=0x7f6b6c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 shutdown_connections 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6b640a2c40 0x7f6b640a5100 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b7c102480 0x7f6b7c1a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7c101ac0 0x7f6b7c19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 --2- 172.21.15.100:0/195643243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c100db0 0x7f6b7c100470 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 >> 172.21.15.100:0/195643243 conn(0x7f6b7c0fb790 msgr2=0x7f6b7c104dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 shutdown_connections 2024-09-12T02:07:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:32.923+0000 7f6b81404640 1 -- 172.21.15.100:0/195643243 wait complete. 2024-09-12T02:07:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:33 smithi100 ceph-mon[31179]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:33.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:33 smithi117 ceph-mon[35240]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:33.421 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:07:33.421 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:07:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 -- 172.21.15.100:0/4006346978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 msgr2=0x7fe4a8107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/4006346978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8107ba0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe498009930 tx=0x7fe49802a420 comp rx=0 tx=0).stop 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 -- 172.21.15.100:0/4006346978 shutdown_connections 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/4006346978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4a81082e0 0x7fe4a810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/4006346978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8107ba0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/4006346978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a8102db0 0x7fe4a8103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 -- 172.21.15.100:0/4006346978 >> 172.21.15.100:0/4006346978 conn(0x7fe4a80fc7d0 msgr2=0x7fe4a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 -- 172.21.15.100:0/4006346978 shutdown_connections 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.114+0000 7fe4af2dc640 1 -- 172.21.15.100:0/4006346978 wait complete. 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 Processor -- start 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 -- start start 2024-09-12T02:07:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4a8102db0 0x7fe4a81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a81082e0 0x7fe4a819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8112050 con 0x7fe4a8103760 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8111ed0 con 0x7fe4a81082e0 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4af2dc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81121d0 con 0x7fe4a8102db0 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4ac877640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4ac877640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43608/0 (socket says 172.21.15.100:43608) 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4ac877640 1 -- 172.21.15.100:0/2296784946 learned_addr learned my addr 172.21.15.100:0/2296784946 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4ad078640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4a8102db0 0x7fe4a81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.115+0000 7fe4ad879640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a81082e0 0x7fe4a819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.116+0000 7fe4ac877640 1 -- 172.21.15.100:0/2296784946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4a8102db0 msgr2=0x7fe4a81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.116+0000 7fe4ac877640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4a8102db0 0x7fe4a81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.116+0000 7fe4ac877640 1 -- 172.21.15.100:0/2296784946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a81082e0 msgr2=0x7fe4a819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.116+0000 7fe4ac877640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a81082e0 0x7fe4a819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.116+0000 7fe4ac877640 1 -- 172.21.15.100:0/2296784946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a819d560 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.116+0000 7fe4ac877640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8198af0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe498005940 tx=0x7fe498003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.118+0000 7fe49e7fc640 1 -- 172.21.15.100:0/2296784946 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49803f070 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.118+0000 7fe49e7fc640 1 -- 172.21.15.100:0/2296784946 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe498031c30 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.118+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a819d7f0 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.118+0000 7fe49e7fc640 1 -- 172.21.15.100:0/2296784946 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498035030 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.118+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a81a5130 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.119+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a8103190 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.120+0000 7fe49e7fc640 1 -- 172.21.15.100:0/2296784946 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe498042070 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.121+0000 7fe49e7fc640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe4940a2c90 0x7fe4940a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.121+0000 7fe49e7fc640 1 -- 172.21.15.100:0/2296784946 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe4980f00e0 con 0x7fe4a8103760 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.121+0000 7fe4ad078640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe4940a2c90 0x7fe4940a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:33.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.122+0000 7fe4ad078640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe4940a2c90 0x7fe4940a5150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400bbe0 tx=0x7fe4a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.125+0000 7fe49e7fc640 1 -- 172.21.15.100:0/2296784946 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe498031de0 con 0x7fe4a8103760 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.345+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4a8199910 con 0x7fe4a8103760 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.346+0000 7fe49e7fc640 1 -- 172.21.15.100:0/2296784946 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7fe4a8199910 con 0x7fe4a8103760 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe4940a2c90 msgr2=0x7fe4940a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe4940a2c90 0x7fe4940a5150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400bbe0 tx=0x7fe4a400b390 comp rx=0 tx=0).stop 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 msgr2=0x7fe4a8198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8198af0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe498005940 tx=0x7fe498003c10 comp rx=0 tx=0).stop 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 shutdown_connections 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fe4940a2c90 0x7fe4940a5150 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a81082e0 0x7fe4a819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4a8103760 0x7fe4a8198af0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 --2- 172.21.15.100:0/2296784946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4a8102db0 0x7fe4a81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 >> 172.21.15.100:0/2296784946 conn(0x7fe4a80fc7d0 msgr2=0x7fe4a8105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 shutdown_connections 2024-09-12T02:07:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:33.348+0000 7fe4af2dc640 1 -- 172.21.15.100:0/2296784946 wait complete. 2024-09-12T02:07:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:33 smithi189 ceph-mon[35188]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:33.708 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:34.154 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T02:07:34.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T02:07:34.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:34 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2296784946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:34.404 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:34 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2296784946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:34.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:34 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2296784946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:34.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 -- 172.21.15.100:0/1007107488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab34102d30 msgr2=0x7fab34103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 --2- 172.21.15.100:0/1007107488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab34102d30 0x7fab34103110 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fab24009930 tx=0x7fab2402a420 comp rx=0 tx=0).stop 2024-09-12T02:07:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 -- 172.21.15.100:0/1007107488 shutdown_connections 2024-09-12T02:07:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 --2- 172.21.15.100:0/1007107488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab341082a0 0x7fab3410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 --2- 172.21.15.100:0/1007107488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab341036e0 0x7fab34107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 --2- 172.21.15.100:0/1007107488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab34102d30 0x7fab34103110 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 -- 172.21.15.100:0/1007107488 >> 172.21.15.100:0/1007107488 conn(0x7fab340fc7d0 msgr2=0x7fab340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.654+0000 7fab3a22d640 1 -- 172.21.15.100:0/1007107488 shutdown_connections 2024-09-12T02:07:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.655+0000 7fab3a22d640 1 -- 172.21.15.100:0/1007107488 wait complete. 2024-09-12T02:07:34.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.655+0000 7fab3a22d640 1 Processor -- start 2024-09-12T02:07:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.655+0000 7fab3a22d640 1 -- start start 2024-09-12T02:07:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab3a22d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab34102d30 0x7fab34198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab3a22d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab341036e0 0x7fab34198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab3a22d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab341082a0 0x7fab3419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab3a22d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab341120f0 con 0x7fab341036e0 2024-09-12T02:07:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab3a22d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab34111f70 con 0x7fab34102d30 2024-09-12T02:07:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab3a22d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112270 con 0x7fab341082a0 2024-09-12T02:07:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab341036e0 0x7fab34198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab341036e0 0x7fab34198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42908/0 (socket says 172.21.15.100:42908) 2024-09-12T02:07:34.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 -- 172.21.15.100:0/905462060 learned_addr learned my addr 172.21.15.100:0/905462060 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:34.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab33fff640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab341082a0 0x7fab3419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab337fe640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab34102d30 0x7fab34198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 -- 172.21.15.100:0/905462060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab341082a0 msgr2=0x7fab3419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab341082a0 0x7fab3419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 -- 172.21.15.100:0/905462060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab34102d30 msgr2=0x7fab34198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab34102d30 0x7fab34198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 -- 172.21.15.100:0/905462060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3419d620 con 0x7fab341036e0 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.656+0000 7fab32ffd640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab341036e0 0x7fab34198bb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fab2800d740 tx=0x7fab2800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.657+0000 7fab30ff9640 1 -- 172.21.15.100:0/905462060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28017070 con 0x7fab341036e0 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.657+0000 7fab30ff9640 1 -- 172.21.15.100:0/905462060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2800de50 con 0x7fab341036e0 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.657+0000 7fab30ff9640 1 -- 172.21.15.100:0/905462060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2800f6b0 con 0x7fab341036e0 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.657+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3419d910 con 0x7fab341036e0 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.657+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab341a51f0 con 0x7fab341036e0 2024-09-12T02:07:34.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.658+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3406a850 con 0x7fab341036e0 2024-09-12T02:07:34.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.659+0000 7fab30ff9640 1 -- 172.21.15.100:0/905462060 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fab2801a070 con 0x7fab341036e0 2024-09-12T02:07:34.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.660+0000 7fab30ff9640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fab1c0a2c10 0x7fab1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:34.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.660+0000 7fab337fe640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fab1c0a2c10 0x7fab1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:34.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.660+0000 7fab30ff9640 1 -- 172.21.15.100:0/905462060 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fab280cebc0 con 0x7fab341036e0 2024-09-12T02:07:34.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.661+0000 7fab337fe640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fab1c0a2c10 0x7fab1c0a50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab24006010 tx=0x7fab24005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:34.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.664+0000 7fab30ff9640 1 -- 172.21.15.100:0/905462060 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab2809b9d0 con 0x7fab341036e0 2024-09-12T02:07:34.723 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:34.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.884+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab34199a00 con 0x7fab341036e0 2024-09-12T02:07:34.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.885+0000 7fab30ff9640 1 -- 172.21.15.100:0/905462060 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7fab34199a00 con 0x7fab341036e0 2024-09-12T02:07:34.885 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:07:34.886 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:07:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.887+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fab1c0a2c10 msgr2=0x7fab1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.887+0000 7fab3a22d640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fab1c0a2c10 0x7fab1c0a50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab24006010 tx=0x7fab24005a20 comp rx=0 tx=0).stop 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab341036e0 msgr2=0x7fab34198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab341036e0 0x7fab34198bb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fab2800d740 tx=0x7fab2800dc00 comp rx=0 tx=0).stop 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 shutdown_connections 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fab1c0a2c10 0x7fab1c0a50d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab341082a0 0x7fab3419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab341036e0 0x7fab34198bb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 --2- 172.21.15.100:0/905462060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab34102d30 0x7fab34198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 >> 172.21.15.100:0/905462060 conn(0x7fab340fc7d0 msgr2=0x7fab34106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 shutdown_connections 2024-09-12T02:07:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:34.888+0000 7fab3a22d640 1 -- 172.21.15.100:0/905462060 wait complete. 2024-09-12T02:07:35.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:35 smithi100 ceph-mon[31179]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:35.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:35 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/905462060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:35 smithi117 ceph-mon[35240]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:35.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:35 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/905462060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:35.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:35 smithi189 ceph-mon[35188]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:35.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:35 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/905462060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:35.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.877+0000 7efc0611c640 1 -- 172.21.15.100:0/3651020875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00106a80 msgr2=0x7efc00106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.877+0000 7efc0611c640 1 --2- 172.21.15.100:0/3651020875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00106a80 0x7efc00106e60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009930 tx=0x7efbf002a420 comp rx=0 tx=0).stop 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.877+0000 7efc0611c640 1 -- 172.21.15.100:0/3651020875 shutdown_connections 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.877+0000 7efc0611c640 1 --2- 172.21.15.100:0/3651020875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc00101420 0x7efc0010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.877+0000 7efc0611c640 1 --2- 172.21.15.100:0/3651020875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc00100a80 0x7efc00100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.877+0000 7efc0611c640 1 --2- 172.21.15.100:0/3651020875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00106a80 0x7efc00106e60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.877+0000 7efc0611c640 1 -- 172.21.15.100:0/3651020875 >> 172.21.15.100:0/3651020875 conn(0x7efc000fc7a0 msgr2=0x7efc000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.878+0000 7efc0611c640 1 -- 172.21.15.100:0/3651020875 shutdown_connections 2024-09-12T02:07:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.878+0000 7efc0611c640 1 -- 172.21.15.100:0/3651020875 wait complete. 2024-09-12T02:07:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 Processor -- start 2024-09-12T02:07:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 -- start start 2024-09-12T02:07:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc00100a80 0x7efc001a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101420 0x7efc001a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc00106a80 0x7efc0019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc00110ed0 con 0x7efc00101420 2024-09-12T02:07:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc00110d50 con 0x7efc00106a80 2024-09-12T02:07:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.879+0000 7efc0611c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efc00111050 con 0x7efc00100a80 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101420 0x7efc001a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101420 0x7efc001a3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42936/0 (socket says 172.21.15.100:42936) 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 -- 172.21.15.100:0/560680711 learned_addr learned my addr 172.21.15.100:0/560680711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbff7fe640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc00100a80 0x7efc001a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbfffff640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc00106a80 0x7efc0019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 -- 172.21.15.100:0/560680711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc00100a80 msgr2=0x7efc001a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc00100a80 0x7efc001a3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 -- 172.21.15.100:0/560680711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc00106a80 msgr2=0x7efc0019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc00106a80 0x7efc0019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbf6ffd640 1 -- 172.21.15.100:0/560680711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0019f3c0 con 0x7efc00101420 2024-09-12T02:07:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.880+0000 7efbfffff640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc00106a80 0x7efc0019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.881+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101420 0x7efc001a3bf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efbe800d950 tx=0x7efbe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.881+0000 7efbfd7fa640 1 -- 172.21.15.100:0/560680711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8017070 con 0x7efc00101420 2024-09-12T02:07:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.881+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0019f6b0 con 0x7efc00101420 2024-09-12T02:07:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.881+0000 7efbfd7fa640 1 -- 172.21.15.100:0/560680711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbe8009c30 con 0x7efc00101420 2024-09-12T02:07:35.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.881+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc001ab790 con 0x7efc00101420 2024-09-12T02:07:35.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.881+0000 7efbfd7fa640 1 -- 172.21.15.100:0/560680711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe800f6b0 con 0x7efc00101420 2024-09-12T02:07:35.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 Processor -- start 2024-09-12T02:07:35.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 -- start start 2024-09-12T02:07:35.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5654d52322a0 con 0x5654d52d7940 2024-09-12T02:07:35.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5654d51d9b10 con 0x5654d52cd080 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efc084f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5654d522e260 con 0x5654d52cc760 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.884+0000 7efbfd7fa640 1 -- 172.21.15.100:0/560680711 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efbe800f850 con 0x7efc00101420 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36308/0 (socket says 172.21.15.100:36308) 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 -- 172.21.15.100:0/2039193770 learned_addr learned my addr 172.21.15.100:0/2039193770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbfffff640 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 -- 172.21.15.100:0/2039193770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 msgr2=0x5654d52ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 -- 172.21.15.100:0/2039193770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 msgr2=0x5654d52d9d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d9d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.885+0000 7efbff7fe640 1 -- 172.21.15.100:0/2039193770 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d4fa3b90 con 0x5654d52cd080 2024-09-12T02:07:35.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.886+0000 7efbff7fe640 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d7400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009930 tx=0x7efbf0005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0d7c76609a130a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.886+0000 7efbf5ffb640 1 -- 172.21.15.100:0/2039193770 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0035040 con 0x5654d52cd080 2024-09-12T02:07:35.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.886+0000 7efbf5ffb640 1 -- 172.21.15.100:0/2039193770 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbf0005520 con 0x5654d52cd080 2024-09-12T02:07:35.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.886+0000 7efbf5ffb640 1 -- 172.21.15.100:0/2039193770 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0003850 con 0x5654d52cd080 2024-09-12T02:07:35.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.886+0000 7efbfd7fa640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efbec0a2c10 0x7efbec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.886+0000 7efbfd7fa640 1 -- 172.21.15.100:0/560680711 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efbe80cef00 con 0x7efc00101420 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.886+0000 7efbfffff640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efbec0a2c10 0x7efbec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 -- 172.21.15.100:0/2039193770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 msgr2=0x5654d52d7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d7400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009930 tx=0x7efbf0005c00 comp rx=0 tx=0).stop 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 -- 172.21.15.100:0/2039193770 shutdown_connections 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d7400 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 --2- 172.21.15.100:0/2039193770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 -- 172.21.15.100:0/2039193770 >> 172.21.15.100:0/2039193770 conn(0x5654d52c8cf0 msgr2=0x5654d52c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efbfffff640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efbec0a2c10 0x7efbec0a50d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efbf8005fd0 tx=0x7efbf80096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 -- 172.21.15.100:0/2039193770 shutdown_connections 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.887+0000 7efc084f5740 1 -- 172.21.15.100:0/2039193770 wait complete. 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.888+0000 7efc084f5740 1 -- start start 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.888+0000 7efc084f5740 1 Processor -- start 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.888+0000 7efc084f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52d4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.888+0000 7efc084f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.888+0000 7efc084f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efc084f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5654d52da510 con 0x5654d52d7940 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efc084f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5654d51ba6e0 con 0x5654d52cd080 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efc084f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5654d52da690 con 0x5654d52cc760 2024-09-12T02:07:35.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36316/0 (socket says 172.21.15.100:36316) 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbf6ffd640 1 -- 172.21.15.100:0/2287762755 learned_addr learned my addr 172.21.15.100:0/2287762755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbfffff640 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efc084f5740 10 client.0 _ll_register_callbacks cb 0x5654d51dea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbff7fe640 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbfffff640 1 -- 172.21.15.100:0/2287762755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 msgr2=0x5654d52d4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbfffff640 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52d4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbfffff640 1 -- 172.21.15.100:0/2287762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 msgr2=0x5654d52d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbfffff640 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.889+0000 7efbfffff640 1 -- 172.21.15.100:0/2287762755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654d52e3ae0 con 0x5654d52d7940 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.890+0000 7efbfffff640 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d52f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efbf8010db0 tx=0x7efbf8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c611ca425ba798bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.890+0000 7efbdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.890+0000 7efbdeffd640 1 -- 172.21.15.100:0/2287762755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8028440 con 0x5654d52d7940 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.890+0000 7efbdeffd640 1 -- 172.21.15.100:0/2287762755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efbf801c3f0 con 0x5654d52d7940 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.890+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbf0005520 con 0x5654d52d7940 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.891+0000 7efbdeffd640 1 -- 172.21.15.100:0/2287762755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efbf801c5f0 con 0x5654d52d7940 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.891+0000 7efc084f5740 10 client.15423 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.891+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5654d52e64d0 con 0x5654d52d7940 2024-09-12T02:07:35.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.891+0000 7efbdeffd640 1 -- 172.21.15.100:0/2287762755 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbf0005520 con 0x5654d52d7940 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efbdeffd640 1 -- 172.21.15.100:0/2287762755 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efbf8026070 con 0x5654d52d7940 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efc084f5740 10 client.15423 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efc084f5740 10 client.15423 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efc084f5740 20 client.15423 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efc084f5740 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d52e7990 0x5654d52e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efc084f5740 4 client.15423 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654d523f9d0 con 0x5654d52e7990 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.892+0000 7efbff7fe640 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d52e7990 0x5654d52e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.893+0000 7efbff7fe640 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d52e7990 0x5654d52e9e00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6e42e82e1c5e7c8 server_cookie=2f3c90d625a0139c in_seq=0 out_seq=0 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.893+0000 7efbdeffd640 10 client.15423 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efbdeffd640 1 -- 172.21.15.100:0/2287762755 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654d523f9d0 con 0x5654d52e7990 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efbdeffd640 10 client.15423 handle_command_reply: tid=0 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 client.15423 shutdown 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 msgr2=0x5654d52d52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d52f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efbf8010db0 tx=0x7efbf8004ab0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 shutdown_connections 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d52e7990 0x5654d52e9e00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52d7940 0x5654d52d52f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cd080 0x5654d52d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 --2- 172.21.15.100:0/2287762755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52d4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 >> 172.21.15.100:0/2287762755 conn(0x5654d52c8cf0 msgr2=0x5654d52ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efbdeffd640 0 client.15423 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 shutdown_connections 2024-09-12T02:07:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.894+0000 7efc084f5740 1 -- 172.21.15.100:0/2287762755 wait complete. 2024-09-12T02:07:35.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.895+0000 7efc084f5740 20 client.15423 trim_cache size 0 max 16384 2024-09-12T02:07:35.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 Processor -- start 2024-09-12T02:07:35.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 -- start start 2024-09-12T02:07:35.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52d7940 0x5654d52efc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efbe0010de0 con 0x5654d52cd080 2024-09-12T02:07:35.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efbe000e6b0 con 0x5654d52d7940 2024-09-12T02:07:35.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efc084f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efbe000c500 con 0x5654d52cc760 2024-09-12T02:07:35.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52ef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42956/0 (socket says 172.21.15.100:42956) 2024-09-12T02:07:35.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efbf6ffd640 1 -- 172.21.15.100:0/2857776541 learned_addr learned my addr 172.21.15.100:0/2857776541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:35.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.925+0000 7efbff7fe640 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf6ffd640 1 -- 172.21.15.100:0/2857776541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 msgr2=0x5654d52ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf6ffd640 1 -- 172.21.15.100:0/2857776541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52d7940 msgr2=0x5654d52efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52d7940 0x5654d52efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf6ffd640 1 -- 172.21.15.100:0/2857776541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d52d3820 con 0x5654d52cd080 2024-09-12T02:07:35.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52ef6d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efbe809b650 tx=0x7efbe8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217cbc72827db63f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf57fa640 1 -- 172.21.15.100:0/2857776541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8020050 con 0x5654d52cd080 2024-09-12T02:07:35.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf57fa640 1 -- 172.21.15.100:0/2857776541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbe80b4070 con 0x5654d52cd080 2024-09-12T02:07:35.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.926+0000 7efbf57fa640 1 -- 172.21.15.100:0/2857776541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe80a3df0 con 0x5654d52cd080 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.927+0000 7efc084f5740 1 -- 172.21.15.100:0/2857776541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 msgr2=0x5654d52ef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.927+0000 7efc084f5740 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52ef6d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efbe809b650 tx=0x7efbe8005f90 comp rx=0 tx=0).stop 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.927+0000 7efc084f5740 1 -- 172.21.15.100:0/2857776541 shutdown_connections 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.927+0000 7efc084f5740 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52d7940 0x5654d52efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.927+0000 7efc084f5740 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52ef6d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.927+0000 7efc084f5740 1 --2- 172.21.15.100:0/2857776541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52cc760 0x5654d52ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.927+0000 7efc084f5740 1 -- 172.21.15.100:0/2857776541 >> 172.21.15.100:0/2857776541 conn(0x5654d52c8cf0 msgr2=0x5654d52ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.928+0000 7efc084f5740 1 -- 172.21.15.100:0/2857776541 shutdown_connections 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.928+0000 7efc084f5740 1 -- 172.21.15.100:0/2857776541 wait complete. 2024-09-12T02:07:35.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.928+0000 7efc084f5740 1 -- start start 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.928+0000 7efc084f5740 1 Processor -- start 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efc084f5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cc760 0x5654d52dc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efc084f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52dce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efc084f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52d7940 0x5654d52dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efc084f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efbe000cb70 con 0x5654d52cd080 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efc084f5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efbe000dfe0 con 0x5654d52cc760 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efc084f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efbe000d240 con 0x5654d52d7940 2024-09-12T02:07:35.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efc084f5740 10 client.0 _ll_register_callbacks cb 0x7efbf8010a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52dce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efbf6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52dce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42962/0 (socket says 172.21.15.100:42962) 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efbf6ffd640 1 -- 172.21.15.100:0/1480975064 learned_addr learned my addr 172.21.15.100:0/1480975064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efbfffff640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52d7940 0x5654d52dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.929+0000 7efbff7fe640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cc760 0x5654d52dc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbf6ffd640 1 -- 172.21.15.100:0/1480975064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52d7940 msgr2=0x5654d52dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52d7940 0x5654d52dd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbf6ffd640 1 -- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cc760 msgr2=0x5654d52dc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:35.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cc760 0x5654d52dc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbf6ffd640 1 -- 172.21.15.100:0/1480975064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654d53526b0 con 0x5654d52cd080 2024-09-12T02:07:35.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbff7fe640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cc760 0x5654d52dc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:35.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbf6ffd640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52dce80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efbe809b3c0 tx=0x7efbe809b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5370447a917fd718 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:35.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbdeffd640 1 -- 172.21.15.100:0/1480975064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe80b9020 con 0x5654d52cd080 2024-09-12T02:07:35.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efbdeffd640 1 -- 172.21.15.100:0/1480975064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efbe80a3df0 con 0x5654d52cd080 2024-09-12T02:07:35.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.930+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbe80b4070 con 0x5654d52cd080 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.931+0000 7efbdeffd640 1 -- 172.21.15.100:0/1480975064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efbe8020030 con 0x5654d52cd080 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.931+0000 7efc084f5740 10 client.15429 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.931+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5654d53538b0 con 0x5654d52cd080 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.931+0000 7efbdeffd640 1 -- 172.21.15.100:0/1480975064 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbe80b4070 con 0x5654d52cd080 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.931+0000 7efbdeffd640 1 -- 172.21.15.100:0/1480975064 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efbe809ab10 con 0x5654d52cd080 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.932+0000 7efc084f5740 10 client.15429 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.932+0000 7efc084f5740 10 client.15429 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.932+0000 7efc084f5740 20 client.15429 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.932+0000 7efc084f5740 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d5354040 0x5654d5356460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.932+0000 7efc084f5740 4 client.15429 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T02:07:35.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.932+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x5654d5239d20 con 0x5654d5354040 2024-09-12T02:07:35.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.932+0000 7efbff7fe640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d5354040 0x5654d5356460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.933+0000 7efbdeffd640 10 client.15429 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:35.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.933+0000 7efbff7fe640 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d5354040 0x5654d5356460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d92c735285e55f4 server_cookie=369cc40701a0fa57 in_seq=0 out_seq=0 2024-09-12T02:07:35.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efbdeffd640 1 -- 172.21.15.100:0/1480975064 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5654d5239d20 con 0x5654d5354040 2024-09-12T02:07:35.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efbdeffd640 10 client.15429 handle_command_reply: tid=0 2024-09-12T02:07:35.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 client.15429 shutdown 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 msgr2=0x5654d52dce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52dce80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efbe809b3c0 tx=0x7efbe809b800 comp rx=0 tx=0).stop 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 shutdown_connections 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5654d5354040 0x5654d5356460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654d52d7940 0x5654d52dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654d52cd080 0x5654d52dce80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 --2- 172.21.15.100:0/1480975064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5654d52cc760 0x5654d52dc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 >> 172.21.15.100:0/1480975064 conn(0x5654d52c8cf0 msgr2=0x5654d52ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.949+0000 7efbdeffd640 0 client.15429 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.950+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 shutdown_connections 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.950+0000 7efc084f5740 1 -- 172.21.15.100:0/1480975064 wait complete. 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.950+0000 7efc084f5740 20 client.15429 trim_cache size 0 max 16384 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 24, 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24452, 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 2, 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stdout: "bf6ca43f": { 2024-09-12T02:07:35.951 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 2, 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 144.5, 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "QUIESCED", 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:07:35.952 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:35.953 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:35.953 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:35.953 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:35.953 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:35.953 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:35.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.950+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efbec0a2c10 msgr2=0x7efbec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.950+0000 7efc0611c640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efbec0a2c10 0x7efbec0a50d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efbf8005fd0 tx=0x7efbf80096a0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101420 msgr2=0x7efc001a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101420 0x7efc001a3bf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efbe800d950 tx=0x7efbe800de10 comp rx=0 tx=0).stop 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 shutdown_connections 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efbec0a2c10 0x7efbec0a50d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc00106a80 0x7efc0019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101420 0x7efc001a3bf0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 --2- 172.21.15.100:0/560680711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc00100a80 0x7efc001a3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 >> 172.21.15.100:0/560680711 conn(0x7efc000fc7a0 msgr2=0x7efc0006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 shutdown_connections 2024-09-12T02:07:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:35.951+0000 7efc0611c640 1 -- 172.21.15.100:0/560680711 wait complete. 2024-09-12T02:07:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:36.711 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bf6ca43f', quiesce took 8.5 seconds. Will release after: 16.0 2024-09-12T02:07:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.252+0000 7fa425235640 1 -- 172.21.15.100:0/1919905898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 msgr2=0x7fa420101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.252+0000 7fa425235640 1 --2- 172.21.15.100:0/1919905898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 0x7fa420101200 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa410009900 tx=0x7fa41002a480 comp rx=0 tx=0).stop 2024-09-12T02:07:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.253+0000 7fa425235640 1 -- 172.21.15.100:0/1919905898 shutdown_connections 2024-09-12T02:07:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.253+0000 7fa425235640 1 --2- 172.21.15.100:0/1919905898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa420102ef0 0x7fa42010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.253+0000 7fa425235640 1 --2- 172.21.15.100:0/1919905898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa420102570 0x7fa4201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.253+0000 7fa425235640 1 --2- 172.21.15.100:0/1919905898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 0x7fa420101200 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.253+0000 7fa425235640 1 -- 172.21.15.100:0/1919905898 >> 172.21.15.100:0/1919905898 conn(0x7fa4200fc7d0 msgr2=0x7fa4200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.253+0000 7fa425235640 1 -- 172.21.15.100:0/1919905898 shutdown_connections 2024-09-12T02:07:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.253+0000 7fa425235640 1 -- 172.21.15.100:0/1919905898 wait complete. 2024-09-12T02:07:37.254 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:37 smithi100 ceph-mon[31179]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T02:07:37.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 Processor -- start 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 -- start start 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 0x7fa420073950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa420102570 0x7fa420073e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa420102ef0 0x7fa42006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110fd0 con 0x7fa420100e20 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110e50 con 0x7fa420102570 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.254+0000 7fa425235640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa420111150 con 0x7fa420102ef0 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 0x7fa420073950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa420102570 0x7fa420073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 0x7fa420073950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42978/0 (socket says 172.21.15.100:42978) 2024-09-12T02:07:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41ed9d640 1 -- 172.21.15.100:0/710336180 learned_addr learned my addr 172.21.15.100:0/710336180 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41f59e640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa420102ef0 0x7fa42006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41e59c640 1 -- 172.21.15.100:0/710336180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa420102ef0 msgr2=0x7fa42006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41e59c640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa420102ef0 0x7fa42006cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41e59c640 1 -- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 msgr2=0x7fa420073950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41e59c640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 0x7fa420073950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41e59c640 1 -- 172.21.15.100:0/710336180 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42006d430 con 0x7fa420102570 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa41e59c640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa420102570 0x7fa420073e90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa41400d720 tx=0x7fa41400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.255+0000 7fa407fff640 1 -- 172.21.15.100:0/710336180 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414017070 con 0x7fa420102570 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.256+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42006d720 con 0x7fa420102570 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.256+0000 7fa407fff640 1 -- 172.21.15.100:0/710336180 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41400de30 con 0x7fa420102570 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.256+0000 7fa407fff640 1 -- 172.21.15.100:0/710336180 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4140047a0 con 0x7fa420102570 2024-09-12T02:07:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.256+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa420071700 con 0x7fa420102570 2024-09-12T02:07:37.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.258+0000 7fa407fff640 1 -- 172.21.15.100:0/710336180 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fa4140099d0 con 0x7fa420102570 2024-09-12T02:07:37.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.259+0000 7fa407fff640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa4080a2d10 0x7fa4080a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.259+0000 7fa407fff640 1 -- 172.21.15.100:0/710336180 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa4140cedd0 con 0x7fa420102570 2024-09-12T02:07:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.259+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa4080a2d10 0x7fa4080a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.259+0000 7fa42760e740 1 Processor -- start 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.259+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa4080a2d10 0x7fa4080a51d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa410000c00 tx=0x7fa4100046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa42760e740 1 -- start start 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa42760e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa42760e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa42760e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 0x5616eb07f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb072a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42988/0 (socket says 172.21.15.100:42988) 2024-09-12T02:07:37.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 -- 172.21.15.100:0/2000469101 learned_addr learned my addr 172.21.15.100:0/2000469101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:37.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5616eafd82f0 con 0x5616eb0725d0 2024-09-12T02:07:37.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5616eaf7fcf0 con 0x5616eb07d370 2024-09-12T02:07:37.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616eafd42b0 con 0x5616eb073b40 2024-09-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 -- 172.21.15.100:0/2000469101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 msgr2=0x5616eb072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 -- 172.21.15.100:0/2000469101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 msgr2=0x5616eb07f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 0x5616eb07f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.260+0000 7fa41e59c640 1 -- 172.21.15.100:0/2000469101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616eaf643a0 con 0x5616eb0725d0 2024-09-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.261+0000 7fa41e59c640 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb072a10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa414097e50 tx=0x7fa414004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1ad55dd0f39449 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.261+0000 7fa4057fa640 1 -- 172.21.15.100:0/2000469101 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4140b4070 con 0x5616eb0725d0 2024-09-12T02:07:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.261+0000 7fa4057fa640 1 -- 172.21.15.100:0/2000469101 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41409f830 con 0x5616eb0725d0 2024-09-12T02:07:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.261+0000 7fa4057fa640 1 -- 172.21.15.100:0/2000469101 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4140cc980 con 0x5616eb0725d0 2024-09-12T02:07:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 msgr2=0x5616eb072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb072a10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa414097e50 tx=0x7fa414004440 comp rx=0 tx=0).stop 2024-09-12T02:07:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 shutdown_connections 2024-09-12T02:07:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 0x5616eb07f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb072a10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 --2- 172.21.15.100:0/2000469101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 >> 172.21.15.100:0/2000469101 conn(0x5616eb03b310 msgr2=0x5616eb06ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 shutdown_connections 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 -- 172.21.15.100:0/2000469101 wait complete. 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 -- start start 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.262+0000 7fa42760e740 1 Processor -- start 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa42760e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb0762f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa42760e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb076830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa42760e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 0x5616eb076d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa42760e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5616eb07ff50 con 0x5616eb0725d0 2024-09-12T02:07:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa42760e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5616eaf93060 con 0x5616eb07d370 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa42760e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616eb0800d0 con 0x5616eb073b40 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa42760e740 10 client.0 _ll_register_callbacks cb 0x5616eace68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb0762f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb0762f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42992/0 (socket says 172.21.15.100:42992) 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 -- 172.21.15.100:0/576027343 learned_addr learned my addr 172.21.15.100:0/576027343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41f59e640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 0x5616eb076d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41e59c640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 -- 172.21.15.100:0/576027343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 msgr2=0x5616eb076830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb076830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 -- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 msgr2=0x5616eb076d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 0x5616eb076d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41ed9d640 1 -- 172.21.15.100:0/576027343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616ead493c0 con 0x5616eb0725d0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.263+0000 7fa41e59c640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb076830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb0762f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa41004bca0 tx=0x7fa41003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e913739b53cb7d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa402ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa402ff5640 1 -- 172.21.15.100:0/576027343 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41005b060 con 0x5616eb0725d0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa402ff5640 1 -- 172.21.15.100:0/576027343 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa410003cf0 con 0x5616eb0725d0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa41409f830 con 0x5616eb0725d0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa402ff5640 1 -- 172.21.15.100:0/576027343 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa410035040 con 0x5616eb0725d0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa42760e740 10 client.15441 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616eb08bba0 con 0x5616eb0725d0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.264+0000 7fa402ff5640 1 -- 172.21.15.100:0/576027343 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41409f830 con 0x5616eb0725d0 2024-09-12T02:07:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa402ff5640 1 -- 172.21.15.100:0/576027343 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa41004b6a0 con 0x5616eb0725d0 2024-09-12T02:07:37.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa42760e740 10 client.15441 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:37.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa42760e740 10 client.15441 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:07:37.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa42760e740 20 client.15441 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:37.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa42760e740 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb08d060 0x5616eb08f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa42760e740 4 client.15441 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:37.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616eafe5860 con 0x5616eb08d060 2024-09-12T02:07:37.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.265+0000 7fa41e59c640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb08d060 0x5616eb08f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.266+0000 7fa402ff5640 10 client.15441 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.266+0000 7fa41e59c640 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb08d060 0x5616eb08f4b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=778b551f5ad77c79 server_cookie=ca49122c5d6f6659 in_seq=0 out_seq=0 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.266+0000 7fa402ff5640 1 -- 172.21.15.100:0/576027343 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616eafe5860 con 0x5616eb08d060 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.266+0000 7fa402ff5640 10 client.15441 handle_command_reply: tid=0 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 client.15441 shutdown 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 msgr2=0x5616eb0762f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb0762f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa41004bca0 tx=0x7fa41003d000 comp rx=0 tx=0).stop 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 shutdown_connections 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb08d060 0x5616eb08f4b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa402ff5640 0 client.15441 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb07d370 0x5616eb076d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb076830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 --2- 172.21.15.100:0/576027343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb0762f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 >> 172.21.15.100:0/576027343 conn(0x5616eb03b310 msgr2=0x5616eb074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.267+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 shutdown_connections 2024-09-12T02:07:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.268+0000 7fa42760e740 1 -- 172.21.15.100:0/576027343 wait complete. 2024-09-12T02:07:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.268+0000 7fa42760e740 20 client.15441 trim_cache size 0 max 16384 2024-09-12T02:07:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.280+0000 7fa42760e740 1 Processor -- start 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa42760e740 1 -- start start 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa42760e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb03b310 0x5616eb076b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa42760e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb0725d0 0x5616eb094d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa42760e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb0952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa42760e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b6400 con 0x5616eb03b310 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa42760e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b3cd0 con 0x5616eb0725d0 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa42760e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b1b20 con 0x5616eb073b40 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb03b310 0x5616eb076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb03b310 0x5616eb076b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42994/0 (socket says 172.21.15.100:42994) 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 -- 172.21.15.100:0/2888491349 learned_addr learned my addr 172.21.15.100:0/2888491349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41e59c640 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb0725d0 0x5616eb094d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41f59e640 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb0952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 -- 172.21.15.100:0/2888491349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 msgr2=0x5616eb0952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb0952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 -- 172.21.15.100:0/2888491349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb0725d0 msgr2=0x5616eb094d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb0725d0 0x5616eb094d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.281+0000 7fa41ed9d640 1 -- 172.21.15.100:0/2888491349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616eb07cba0 con 0x5616eb03b310 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.282+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb03b310 0x5616eb076b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa410004770 tx=0x7fa410009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e74bef90b794184 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.282+0000 7fa404ff9640 1 -- 172.21.15.100:0/2888491349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410066070 con 0x5616eb03b310 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.282+0000 7fa404ff9640 1 -- 172.21.15.100:0/2888491349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa410049bd0 con 0x5616eb03b310 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.282+0000 7fa404ff9640 1 -- 172.21.15.100:0/2888491349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41005b040 con 0x5616eb03b310 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 -- 172.21.15.100:0/2888491349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb03b310 msgr2=0x5616eb076b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb03b310 0x5616eb076b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa410004770 tx=0x7fa410009260 comp rx=0 tx=0).stop 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 -- 172.21.15.100:0/2888491349 shutdown_connections 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb073b40 0x5616eb0952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb0725d0 0x5616eb094d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 --2- 172.21.15.100:0/2888491349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb03b310 0x5616eb076b90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 -- 172.21.15.100:0/2888491349 >> 172.21.15.100:0/2888491349 conn(0x5616eb083da0 msgr2=0x5616eb06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 -- 172.21.15.100:0/2888491349 shutdown_connections 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 -- 172.21.15.100:0/2888491349 wait complete. 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.283+0000 7fa42760e740 1 -- start start 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa42760e740 1 Processor -- start 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa42760e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb03b310 0x5616eb0853c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa42760e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb085900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa42760e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb073b40 0x5616eb085e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa42760e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b2190 con 0x5616eb0725d0 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa42760e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b3600 con 0x5616eb073b40 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa41e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb085900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa41e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb085900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43004/0 (socket says 172.21.15.100:43004) 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa41e59c640 1 -- 172.21.15.100:0/2377377408 learned_addr learned my addr 172.21.15.100:0/2377377408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b2860 con 0x5616eb03b310 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.284+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb03b310 0x5616eb0853c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa42760e740 10 client.0 _ll_register_callbacks cb 0x7fa4100041c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41f59e640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb073b40 0x5616eb085e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41ed9d640 1 -- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb073b40 msgr2=0x5616eb085e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb073b40 0x5616eb085e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41ed9d640 1 -- 172.21.15.100:0/2377377408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 msgr2=0x5616eb085900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb085900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41ed9d640 1 -- 172.21.15.100:0/2377377408 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616eb0f6fa0 con 0x5616eb03b310 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41f59e640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb073b40 0x5616eb085e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa41ed9d640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb03b310 0x5616eb0853c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa41003f040 tx=0x7fa410005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce5d4297600c2a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa402ff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa402ff5640 1 -- 172.21.15.100:0/2377377408 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41005b070 con 0x5616eb03b310 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa410049bd0 con 0x5616eb03b310 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.285+0000 7fa402ff5640 1 -- 172.21.15.100:0/2377377408 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa410031b90 con 0x5616eb03b310 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa402ff5640 1 -- 172.21.15.100:0/2377377408 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa410066070 con 0x5616eb03b310 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 10 client.24925 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616eb0f82a0 con 0x5616eb03b310 2024-09-12T02:07:37.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa402ff5640 1 -- 172.21.15.100:0/2377377408 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa410049bd0 con 0x5616eb03b310 2024-09-12T02:07:37.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa402ff5640 1 -- 172.21.15.100:0/2377377408 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa41006b450 con 0x5616eb03b310 2024-09-12T02:07:37.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 10 client.24925 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 10 client.24925 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 20 client.24925 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb07d370 0x5616eb0fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 4 client.24925 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616eafdfd70 con 0x5616eb07d370 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.286+0000 7fa41e59c640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb07d370 0x5616eb0fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa402ff5640 10 client.24925 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa41e59c640 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb07d370 0x5616eb0fa8b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a6ce2f85b9edc561 server_cookie=ba65413731a70cee in_seq=0 out_seq=0 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa402ff5640 1 -- 172.21.15.100:0/2377377408 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616eafdfd70 con 0x5616eb07d370 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa402ff5640 10 client.24925 handle_command_reply: tid=0 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 client.24925 shutdown 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb03b310 msgr2=0x5616eb0853c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb03b310 0x5616eb0853c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa41003f040 tx=0x7fa410005970 comp rx=0 tx=0).stop 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 shutdown_connections 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x5616eb07d370 0x5616eb0fa8b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5616eb073b40 0x5616eb085e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616eb0725d0 0x5616eb085900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa402ff5640 0 client.24925 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 --2- 172.21.15.100:0/2377377408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616eb03b310 0x5616eb0853c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 >> 172.21.15.100:0/2377377408 conn(0x5616eb083da0 msgr2=0x5616eb079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.287+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 shutdown_connections 2024-09-12T02:07:37.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa42760e740 1 -- 172.21.15.100:0/2377377408 wait complete. 2024-09-12T02:07:37.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa42760e740 20 client.24925 trim_cache size 0 max 16384 2024-09-12T02:07:37.293 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:07:37.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa4080a2d10 msgr2=0x7fa4080a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa4080a2d10 0x7fa4080a51d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa410000c00 tx=0x7fa4100046c0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa420102570 msgr2=0x7fa420073e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa420102570 0x7fa420073e90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa41400d720 tx=0x7fa41400dbe0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 shutdown_connections 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fa4080a2d10 0x7fa4080a51d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa420102ef0 0x7fa42006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.288+0000 7fa425235640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa420102570 0x7fa420073e90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.289+0000 7fa425235640 1 --2- 172.21.15.100:0/710336180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa420100e20 0x7fa420073950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.289+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 >> 172.21.15.100:0/710336180 conn(0x7fa4200fc7d0 msgr2=0x7fa4200fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.289+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 shutdown_connections 2024-09-12T02:07:37.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:37.289+0000 7fa425235640 1 -- 172.21.15.100:0/710336180 wait complete. 2024-09-12T02:07:37.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:37 smithi117 ceph-mon[35240]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T02:07:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:37 smithi189 ceph-mon[35188]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T02:07:38.045 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:07:38.373 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:38.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 -- 172.21.15.100:0/3993322638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102570 msgr2=0x7f96b01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3993322638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102570 0x7f96b01029b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009900 tx=0x7f96a002a480 comp rx=0 tx=0).stop 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 -- 172.21.15.100:0/3993322638 shutdown_connections 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3993322638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b0102ef0 0x7f96b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3993322638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102570 0x7f96b01029b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3993322638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0100e20 0x7f96b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 -- 172.21.15.100:0/3993322638 >> 172.21.15.100:0/3993322638 conn(0x7f96b00fc7d0 msgr2=0x7f96b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 -- 172.21.15.100:0/3993322638 shutdown_connections 2024-09-12T02:07:38.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.867+0000 7f96b7f41640 1 -- 172.21.15.100:0/3993322638 wait complete. 2024-09-12T02:07:38.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.868+0000 7f96b7f41640 1 Processor -- start 2024-09-12T02:07:38.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.868+0000 7f96b7f41640 1 -- start start 2024-09-12T02:07:38.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.868+0000 7f96b7f41640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b0100e20 0x7f96b0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.868+0000 7f96b7f41640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0102570 0x7f96b01998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.868+0000 7f96b7f41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102ef0 0x7f96b01a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b7f41640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0110f80 con 0x7f96b0102ef0 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b7f41640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0110e00 con 0x7f96b0100e20 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b7f41640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0111100 con 0x7f96b0102570 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0102570 0x7f96b01998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0102570 0x7f96b01998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38768/0 (socket says 172.21.15.100:38768) 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 -- 172.21.15.100:0/3060217638 learned_addr learned my addr 172.21.15.100:0/3060217638 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b64de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102ef0 0x7f96b01a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b0100e20 0x7f96b0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 -- 172.21.15.100:0/3060217638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b0100e20 msgr2=0x7f96b0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b0100e20 0x7f96b0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 -- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102ef0 msgr2=0x7f96b01a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102ef0 0x7f96b01a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b54dc640 1 -- 172.21.15.100:0/3060217638 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b01a4950 con 0x7f96b0102570 2024-09-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.869+0000 7f96b64de640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102ef0 0x7f96b01a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.870+0000 7f96b54dc640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0102570 0x7f96b01998d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006010 tx=0x7f96a0003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.870+0000 7f96a6ffd640 1 -- 172.21.15.100:0/3060217638 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a003f070 con 0x7f96b0102570 2024-09-12T02:07:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.870+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b01a4b20 con 0x7f96b0102570 2024-09-12T02:07:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.870+0000 7f96a6ffd640 1 -- 172.21.15.100:0/3060217638 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a0031e30 con 0x7f96b0102570 2024-09-12T02:07:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.870+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b01a4fd0 con 0x7f96b0102570 2024-09-12T02:07:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.871+0000 7f96a6ffd640 1 -- 172.21.15.100:0/3060217638 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0035030 con 0x7f96b0102570 2024-09-12T02:07:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.872+0000 7f96a6ffd640 1 -- 172.21.15.100:0/3060217638 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f96a0042070 con 0x7f96b0102570 2024-09-12T02:07:38.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.873+0000 7f96ba31a740 1 Processor -- start 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.873+0000 7f96ba31a740 1 -- start start 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96a6ffd640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f969c0a2af0 0x7f969c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458ffb40 0x559c458fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458fe5d0 0x559c458fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96b64de640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f969c0a2af0 0x7f969c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96b5cdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458ffb40 0x559c458fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96b5cdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458ffb40 0x559c458fe090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43030/0 (socket says 172.21.15.100:43030) 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96b5cdd640 1 -- 172.21.15.100:0/689121157 learned_addr learned my addr 172.21.15.100:0/689121157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96a6ffd640 1 -- 172.21.15.100:0/3060217638 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f96a00ef9f0 con 0x7f96b0102570 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96ba31a740 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 0x559c4590fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96b54dc640 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458fe5d0 0x559c458fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559c458642f0 con 0x559c458ffb40 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559c4580bcf0 con 0x559c458fe5d0 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559c458602b0 con 0x559c4590d780 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.874+0000 7f96b5cdd640 1 -- 172.21.15.100:0/689121157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 msgr2=0x559c4590fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 0x559c4590fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f96b5cdd640 1 -- 172.21.15.100:0/689121157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458fe5d0 msgr2=0x559c458fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458fe5d0 0x559c458fea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f96b5cdd640 1 -- 172.21.15.100:0/689121157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c457f03a0 con 0x559c458ffb40 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f96b64de640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f969c0a2af0 0x7f969c0a4fb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f96a800f5b0 tx=0x7f96a800f9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458ffb40 0x559c458fe090 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00ac10 tx=0x7f96ac00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669ee00ff696a622 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f969bfff640 1 -- 172.21.15.100:0/689121157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac01d070 con 0x559c458ffb40 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f969bfff640 1 -- 172.21.15.100:0/689121157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96ac018b20 con 0x559c458ffb40 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.875+0000 7f969bfff640 1 -- 172.21.15.100:0/689121157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac010b10 con 0x559c458ffb40 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458ffb40 msgr2=0x559c458fe090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458ffb40 0x559c458fe090 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00ac10 tx=0x7f96ac00f790 comp rx=0 tx=0).stop 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 shutdown_connections 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 0x559c4590fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458fe5d0 0x559c458fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 --2- 172.21.15.100:0/689121157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458ffb40 0x559c458fe090 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 >> 172.21.15.100:0/689121157 conn(0x559c458c7310 msgr2=0x559c458fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 shutdown_connections 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.876+0000 7f96ba31a740 1 -- 172.21.15.100:0/689121157 wait complete. 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 -- start start 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 Processor -- start 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c4590d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458ffb40 0x559c4590a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4590d780 0x559c4590a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559c45910480 con 0x559c458fe5d0 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559c4581f060 con 0x559c4590d780 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559c45910600 con 0x559c458ffb40 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96b5cdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c4590d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96ba31a740 10 client.0 _ll_register_callbacks cb 0x559c455728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96b5cdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c4590d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43040/0 (socket says 172.21.15.100:43040) 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.877+0000 7f96b5cdd640 1 -- 172.21.15.100:0/714612001 learned_addr learned my addr 172.21.15.100:0/714612001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b54dc640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458ffb40 0x559c4590a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b64de640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4590d780 0x559c4590a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b5cdd640 1 -- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458ffb40 msgr2=0x559c4590a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458ffb40 0x559c4590a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b5cdd640 1 -- 172.21.15.100:0/714612001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4590d780 msgr2=0x559c4590a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4590d780 0x559c4590a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b5cdd640 1 -- 172.21.15.100:0/714612001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c455d53c0 con 0x559c458fe5d0 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b64de640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4590d780 0x559c4590a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c4590d130 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f96ac010470 tx=0x7f96ac018a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d60f4ac5b73676 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96997fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96997fa640 1 -- 172.21.15.100:0/714612001 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac027020 con 0x559c458fe5d0 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96997fa640 1 -- 172.21.15.100:0/714612001 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f96ac010890 con 0x559c458fe5d0 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.878+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96ac018b20 con 0x559c458fe5d0 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96997fa640 1 -- 172.21.15.100:0/714612001 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96ac01d040 con 0x559c458fe5d0 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 10 client.15459 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559c4591bed0 con 0x559c458fe5d0 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96997fa640 1 -- 172.21.15.100:0/714612001 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96ac018b20 con 0x559c458fe5d0 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96997fa640 1 -- 172.21.15.100:0/714612001 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f96ac0046c0 con 0x559c458fe5d0 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 10 client.15459 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 10 client.15459 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 20 client.15459 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c4591d280 0x559c4591f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 4 client.15459 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c45871860 con 0x559c4591d280 2024-09-12T02:07:38.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.879+0000 7f96b54dc640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c4591d280 0x559c4591f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.880+0000 7f96997fa640 10 client.15459 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.880+0000 7f96b54dc640 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c4591d280 0x559c4591f670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=433331d21f4c283b server_cookie=eaa4971e8cec0d23 in_seq=0 out_seq=0 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96997fa640 1 -- 172.21.15.100:0/714612001 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c45871860 con 0x559c4591d280 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96997fa640 10 client.15459 handle_command_reply: tid=0 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 client.15459 shutdown 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 msgr2=0x559c4590d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c4590d130 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f96ac010470 tx=0x7f96ac018a50 comp rx=0 tx=0).stop 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 shutdown_connections 2024-09-12T02:07:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4590d780 0x559c4590a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c4591d280 0x559c4591f670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458ffb40 0x559c4590a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 --2- 172.21.15.100:0/714612001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c4590d130 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96997fa640 0 client.15459 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 >> 172.21.15.100:0/714612001 conn(0x559c458c7310 msgr2=0x559c45900930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 shutdown_connections 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 1 -- 172.21.15.100:0/714612001 wait complete. 2024-09-12T02:07:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.881+0000 7f96ba31a740 20 client.15459 trim_cache size 0 max 16384 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.905+0000 7f96ba31a740 1 Processor -- start 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.905+0000 7f96ba31a740 1 -- start start 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.905+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458fe5d0 0x559c45919720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.905+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c45909290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c4590d780 0x559c45924ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96ba31a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96b01ad7e0 con 0x559c4590d780 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96ba31a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96b01ab0b0 con 0x559c458ffb40 2024-09-12T02:07:38.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96ba31a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96b01a8f40 con 0x559c458fe5d0 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c4590d780 0x559c45924ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c4590d780 0x559c45924ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43046/0 (socket says 172.21.15.100:43046) 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 -- 172.21.15.100:0/2279736582 learned_addr learned my addr 172.21.15.100:0/2279736582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b54dc640 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c45909290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458fe5d0 0x559c45919720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 -- 172.21.15.100:0/2279736582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458fe5d0 msgr2=0x559c45919720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458fe5d0 0x559c45919720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 -- 172.21.15.100:0/2279736582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 msgr2=0x559c45909290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c45909290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 -- 172.21.15.100:0/2279736582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c458fb960 con 0x559c4590d780 2024-09-12T02:07:38.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b54dc640 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c45909290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:38.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.906+0000 7f96b64de640 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c4590d780 0x559c45924ca0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f96a8012590 tx=0x7f96a8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d82cb6175e31533 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.907+0000 7f969b7fe640 1 -- 172.21.15.100:0/2279736582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a800d9d0 con 0x559c4590d780 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.907+0000 7f969b7fe640 1 -- 172.21.15.100:0/2279736582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a8016040 con 0x559c4590d780 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.907+0000 7f969b7fe640 1 -- 172.21.15.100:0/2279736582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8010430 con 0x559c4590d780 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 -- 172.21.15.100:0/2279736582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c4590d780 msgr2=0x559c45924ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c4590d780 0x559c45924ca0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f96a8012590 tx=0x7f96a8014000 comp rx=0 tx=0).stop 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 -- 172.21.15.100:0/2279736582 shutdown_connections 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c4590d780 0x559c45924ca0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c45909290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 --2- 172.21.15.100:0/2279736582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c458fe5d0 0x559c45919720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 -- 172.21.15.100:0/2279736582 >> 172.21.15.100:0/2279736582 conn(0x559c458c7310 msgr2=0x559c45908b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 -- 172.21.15.100:0/2279736582 shutdown_connections 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 -- 172.21.15.100:0/2279736582 wait complete. 2024-09-12T02:07:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 -- start start 2024-09-12T02:07:38.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.908+0000 7f96ba31a740 1 Processor -- start 2024-09-12T02:07:38.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c45915fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c459112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96ba31a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 0x559c45911810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96ba31a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96b01a9590 con 0x559c458fe5d0 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96ba31a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96b01aa9e0 con 0x559c458ffb40 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96ba31a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96b01a9c40 con 0x559c4590d780 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96ba31a740 10 client.0 _ll_register_callbacks cb 0x7f96ac01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96b5cdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c45915fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96b5cdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c45915fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43060/0 (socket says 172.21.15.100:43060) 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96b5cdd640 1 -- 172.21.15.100:0/108884183 learned_addr learned my addr 172.21.15.100:0/108884183 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96b54dc640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c459112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.909+0000 7f96b64de640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 0x559c45911810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96b5cdd640 1 -- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 msgr2=0x559c45911810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 0x559c45911810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96b5cdd640 1 -- 172.21.15.100:0/108884183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 msgr2=0x559c459112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c459112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96b5cdd640 1 -- 172.21.15.100:0/108884183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c45912010 con 0x559c458fe5d0 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96b54dc640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c459112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96b5cdd640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c45915fa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f96ac030040 tx=0x7f96ac010a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74be12510287106 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96997fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96997fa640 1 -- 172.21.15.100:0/108884183 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac027040 con 0x559c458fe5d0 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96997fa640 1 -- 172.21.15.100:0/108884183 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f96ac004f00 con 0x559c458fe5d0 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a8016040 con 0x559c458fe5d0 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96997fa640 1 -- 172.21.15.100:0/108884183 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96ac0104a0 con 0x559c458fe5d0 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96ba31a740 10 client.15465 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.910+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559c45987bb0 con 0x559c458fe5d0 2024-09-12T02:07:38.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.911+0000 7f96997fa640 1 -- 172.21.15.100:0/108884183 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a8016040 con 0x559c458fe5d0 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96997fa640 1 -- 172.21.15.100:0/108884183 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f96ac035070 con 0x559c458fe5d0 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96ba31a740 10 client.15465 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96ba31a740 10 client.15465 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96ba31a740 20 client.15465 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96ba31a740 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c45988220 0x559c4598a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96ba31a740 4 client.15465 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c4586bd70 con 0x559c45988220 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96b54dc640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c45988220 0x559c4598a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96b54dc640 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c45988220 0x559c4598a610 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71ce88a595a1ed52 server_cookie=b7187305eff01abc in_seq=0 out_seq=0 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96997fa640 10 client.15465 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.912+0000 7f96997fa640 1 -- 172.21.15.100:0/108884183 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c4586bd70 con 0x559c45988220 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96997fa640 10 client.15465 handle_command_reply: tid=0 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 client.15465 shutdown 2024-09-12T02:07:38.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 msgr2=0x559c45915fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c45915fa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f96ac030040 tx=0x7f96ac010a10 comp rx=0 tx=0).stop 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 shutdown_connections 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x559c45988220 0x559c4598a610 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96997fa640 0 client.15465 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c4590d780 0x559c45911810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c458ffb40 0x559c459112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 --2- 172.21.15.100:0/108884183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559c458fe5d0 0x559c45915fa0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 >> 172.21.15.100:0/108884183 conn(0x559c458c7310 msgr2=0x559c458f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 shutdown_connections 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 1 -- 172.21.15.100:0/108884183 wait complete. 2024-09-12T02:07:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.913+0000 7f96ba31a740 20 client.15465 trim_cache size 0 max 16384 2024-09-12T02:07:38.916 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:07:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f969c0a2af0 msgr2=0x7f969c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f969c0a2af0 0x7f969c0a4fb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f96a800f5b0 tx=0x7f96a800f9b0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0102570 msgr2=0x7f96b01998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0102570 0x7f96b01998d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006010 tx=0x7f96a0003c80 comp rx=0 tx=0).stop 2024-09-12T02:07:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 shutdown_connections 2024-09-12T02:07:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f969c0a2af0 0x7f969c0a4fb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b0102ef0 0x7f96b01a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96b0102570 0x7f96b01998d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 --2- 172.21.15.100:0/3060217638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b0100e20 0x7f96b0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 >> 172.21.15.100:0/3060217638 conn(0x7f96b00fc7d0 msgr2=0x7f96b0105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 shutdown_connections 2024-09-12T02:07:38.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:38.914+0000 7f96b7f41640 1 -- 172.21.15.100:0/3060217638 wait complete. 2024-09-12T02:07:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:39 smithi117 ceph-mon[35240]: pgmap v350: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T02:07:39.466 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:39 smithi100 ceph-mon[31179]: pgmap v350: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T02:07:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:39 smithi189 ceph-mon[35188]: pgmap v350: 97 pgs: 97 active+clean; 657 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T02:07:39.619 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:07:39.907 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:40.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 -- 172.21.15.100:0/43403296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd8102d30 msgr2=0x7f4bd8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 --2- 172.21.15.100:0/43403296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd8102d30 0x7f4bd8103110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009930 tx=0x7f4bd402a420 comp rx=0 tx=0).stop 2024-09-12T02:07:40.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 -- 172.21.15.100:0/43403296 shutdown_connections 2024-09-12T02:07:40.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 --2- 172.21.15.100:0/43403296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd81082a0 0x7f4bd810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 --2- 172.21.15.100:0/43403296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd81036e0 0x7f4bd8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 --2- 172.21.15.100:0/43403296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd8102d30 0x7f4bd8103110 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 -- 172.21.15.100:0/43403296 >> 172.21.15.100:0/43403296 conn(0x7f4bd80fc7d0 msgr2=0x7f4bd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 -- 172.21.15.100:0/43403296 shutdown_connections 2024-09-12T02:07:40.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.478+0000 7f4be00c4640 1 -- 172.21.15.100:0/43403296 wait complete. 2024-09-12T02:07:40.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 Processor -- start 2024-09-12T02:07:40.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 -- start start 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8102d30 0x7f4bd81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd81036e0 0x7f4bd8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd81082a0 0x7f4bd819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd81120a0 con 0x7f4bd81036e0 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd8111f20 con 0x7f4bd8102d30 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4be00c4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd8112220 con 0x7f4bd81082a0 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4bdd65f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd81036e0 0x7f4bd8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4bdd65f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd81036e0 0x7f4bd8198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43090/0 (socket says 172.21.15.100:43090) 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1889639342 learned_addr learned my addr 172.21.15.100:0/1889639342 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:40.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.479+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8102d30 0x7f4bd81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1889639342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd81082a0 msgr2=0x7f4bd819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bde661640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd81082a0 0x7f4bd819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd81082a0 0x7f4bd819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1889639342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8102d30 msgr2=0x7f4bd81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8102d30 0x7f4bd81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1889639342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd819d590 con 0x7f4bd81036e0 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd81036e0 0x7f4bd8198b20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800d750 tx=0x7f4bc800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bceffd640 1 -- 172.21.15.100:0/1889639342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8017070 con 0x7f4bd81036e0 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bceffd640 1 -- 172.21.15.100:0/1889639342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bc8005500 con 0x7f4bd81036e0 2024-09-12T02:07:40.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd819d880 con 0x7f4bd81036e0 2024-09-12T02:07:40.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.480+0000 7f4bceffd640 1 -- 172.21.15.100:0/1889639342 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8004e00 con 0x7f4bd81036e0 2024-09-12T02:07:40.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.481+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd81a5160 con 0x7f4bd81036e0 2024-09-12T02:07:40.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.483+0000 7f4bceffd640 1 -- 172.21.15.100:0/1889639342 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4bc8004fa0 con 0x7f4bd81036e0 2024-09-12T02:07:40.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.483+0000 7f4bceffd640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4bc40a2c90 0x7f4bc40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.484+0000 7f4bceffd640 1 -- 172.21.15.100:0/1889639342 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4bc80ce790 con 0x7f4bd81036e0 2024-09-12T02:07:40.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.484+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4bc40a2c90 0x7f4bc40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.484+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4bc40a2c90 0x7f4bc40a5150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009900 tx=0x7f4bd40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.485+0000 7f4be249d740 1 Processor -- start 2024-09-12T02:07:40.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.485+0000 7f4be249d740 1 -- start start 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.485+0000 7f4be249d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.485+0000 7f4be249d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc25d0 0x56375afc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4be249d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afcf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc25d0 0x56375afc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc25d0 0x56375afc2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43104/0 (socket says 172.21.15.100:43104) 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 -- 172.21.15.100:0/198996314 learned_addr learned my addr 172.21.15.100:0/198996314 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56375af282f0 con 0x56375afc25d0 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56375aecfcf0 con 0x56375afc3b40 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56375af242b0 con 0x56375afcd370 2024-09-12T02:07:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdde60640 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bde661640 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afcf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 -- 172.21.15.100:0/198996314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 msgr2=0x56375afcf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afcf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 -- 172.21.15.100:0/198996314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 msgr2=0x56375afc2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.486+0000 7f4bdd65f640 1 -- 172.21.15.100:0/198996314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375aeb43a0 con 0x56375afc25d0 2024-09-12T02:07:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.487+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc25d0 0x56375afc2a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8097870 tx=0x7f4bc809b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2054bf84b680ce43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.487+0000 7f4bc3fff640 1 -- 172.21.15.100:0/198996314 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8020040 con 0x56375afc25d0 2024-09-12T02:07:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.487+0000 7f4bc3fff640 1 -- 172.21.15.100:0/198996314 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bc80a3b10 con 0x56375afc25d0 2024-09-12T02:07:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.487+0000 7f4bc3fff640 1 -- 172.21.15.100:0/198996314 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8009cc0 con 0x56375afc25d0 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc25d0 msgr2=0x56375afc2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc25d0 0x56375afc2a10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8097870 tx=0x7f4bc809b5a0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 shutdown_connections 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afcf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc25d0 0x56375afc2a10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 --2- 172.21.15.100:0/198996314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 >> 172.21.15.100:0/198996314 conn(0x56375af8b310 msgr2=0x56375afbec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 shutdown_connections 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.488+0000 7f4be249d740 1 -- 172.21.15.100:0/198996314 wait complete. 2024-09-12T02:07:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.489+0000 7f4be249d740 1 -- start start 2024-09-12T02:07:40.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.489+0000 7f4be249d740 1 Processor -- start 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4be249d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4be249d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4be249d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4bdde60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4bdde60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43108/0 (socket says 172.21.15.100:43108) 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4bdde60640 1 -- 172.21.15.100:0/3053640296 learned_addr learned my addr 172.21.15.100:0/3053640296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56375afd0070 con 0x56375afc3b40 2024-09-12T02:07:40.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56375aee3060 con 0x56375afcadb0 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4bde661640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.490+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56375afd01f0 con 0x56375afcd370 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4be249d740 10 client.0 _ll_register_callbacks cb 0x56375ac368c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bdde60640 1 -- 172.21.15.100:0/3053640296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 msgr2=0x56375afca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bdde60640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bdde60640 1 -- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 msgr2=0x56375afd9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bdde60640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bdde60640 1 -- 172.21.15.100:0/3053640296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375ac993c0 con 0x56375afc3b40 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bde661640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bdde60640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afca330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009930 tx=0x7f4bd4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c44b6225512b94f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bc17fa640 1 -- 172.21.15.100:0/3053640296 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4035040 con 0x56375afc3b40 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4bc17fa640 1 -- 172.21.15.100:0/3053640296 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4bd4003a00 con 0x56375afc3b40 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.491+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bc80a3b10 con 0x56375afc3b40 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4bc17fa640 1 -- 172.21.15.100:0/3053640296 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4bd4003c00 con 0x56375afc3b40 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 10 client.15477 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56375afdc1b0 con 0x56375afc3b40 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4bc17fa640 1 -- 172.21.15.100:0/3053640296 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bc80a3b10 con 0x56375afc3b40 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4bc17fa640 1 -- 172.21.15.100:0/3053640296 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4bd404a430 con 0x56375afc3b40 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 10 client.15477 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 20 client.15477 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afdd990 0x56375afdfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 4 client.15477 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.492+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56375af35860 con 0x56375afdd990 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.493+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afdd990 0x56375afdfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.493+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afdd990 0x56375afdfd80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb829466a5b2ba5e server_cookie=69937baa7cebb353 in_seq=0 out_seq=0 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.493+0000 7f4bc17fa640 10 client.15477 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4bc17fa640 1 -- 172.21.15.100:0/3053640296 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56375af35860 con 0x56375afdd990 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4bc17fa640 10 client.15477 handle_command_reply: tid=0 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 client.15477 shutdown 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 msgr2=0x56375afca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afca330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009930 tx=0x7f4bd4009260 comp rx=0 tx=0).stop 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 shutdown_connections 2024-09-12T02:07:40.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afdd990 0x56375afdfd80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 --2- 172.21.15.100:0/3053640296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afca330 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 >> 172.21.15.100:0/3053640296 conn(0x56375af8b310 msgr2=0x56375afc4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4bc17fa640 0 client.15477 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 shutdown_connections 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.494+0000 7f4be249d740 1 -- 172.21.15.100:0/3053640296 wait complete. 2024-09-12T02:07:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.495+0000 7f4be249d740 20 client.15477 trim_cache size 0 max 16384 2024-09-12T02:07:40.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.507+0000 7f4be249d740 1 Processor -- start 2024-09-12T02:07:40.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.507+0000 7f4be249d740 1 -- start start 2024-09-12T02:07:40.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4be249d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afc5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4be249d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afc5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afc5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43122/0 (socket says 172.21.15.100:43122) 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 -- 172.21.15.100:0/1464528140 learned_addr learned my addr 172.21.15.100:0/1464528140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4be249d740 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afc4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd81afe20 con 0x56375afc3b40 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd81ad6f0 con 0x56375afcadb0 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd81ab540 con 0x56375afcd370 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bde661640 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afc4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 -- 172.21.15.100:0/1464528140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 msgr2=0x56375afc4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afc4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 -- 172.21.15.100:0/1464528140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 msgr2=0x56375afd9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.508+0000 7f4bdde60640 1 -- 172.21.15.100:0/1464528140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375afc3780 con 0x56375afc3b40 2024-09-12T02:07:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.509+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afc5ae0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4bd402a940 tx=0x7f4bd402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e60fd9429d4bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.510+0000 7f4bc37fe640 1 -- 172.21.15.100:0/1464528140 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4035040 con 0x56375afc3b40 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.510+0000 7f4bc37fe640 1 -- 172.21.15.100:0/1464528140 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bd4063070 con 0x56375afc3b40 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.510+0000 7f4bc37fe640 1 -- 172.21.15.100:0/1464528140 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd404a690 con 0x56375afc3b40 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.510+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 msgr2=0x56375afc5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.510+0000 7f4be249d740 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afc5ae0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4bd402a940 tx=0x7f4bd402a420 comp rx=0 tx=0).stop 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 shutdown_connections 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375afc4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afcadb0 0x56375afd9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 --2- 172.21.15.100:0/1464528140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afc3b40 0x56375afc5ae0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 >> 172.21.15.100:0/1464528140 conn(0x56375af8b310 msgr2=0x56375afc4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 shutdown_connections 2024-09-12T02:07:40.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 -- 172.21.15.100:0/1464528140 wait complete. 2024-09-12T02:07:40.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 -- start start 2024-09-12T02:07:40.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.511+0000 7f4be249d740 1 Processor -- start 2024-09-12T02:07:40.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4be249d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4be249d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afcadb0 0x56375b045370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4be249d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375b0458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4be249d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd81abbb0 con 0x56375afcadb0 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4bdd65f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afcadb0 0x56375b045370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4bdd65f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afcadb0 0x56375b045370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43126/0 (socket says 172.21.15.100:43126) 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1716173327 learned_addr learned my addr 172.21.15.100:0/1716173327 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd81ad020 con 0x56375afc3b40 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd81ac280 con 0x56375afcd370 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4be249d740 10 client.0 _ll_register_callbacks cb 0x7f4bd4009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.512+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bde661640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375b0458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1716173327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 msgr2=0x56375b0458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375b0458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 msgr2=0x56375afc7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bdd65f640 1 -- 172.21.15.100:0/1716173327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375b0460e0 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bdd65f640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afcadb0 0x56375b045370 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4bc809ae30 tx=0x7f4bc8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597bf5684c6acc18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bc17fa640 1 -- 172.21.15.100:0/1716173327 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8020040 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4bc17fa640 1 -- 172.21.15.100:0/1716173327 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4bc8005290 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.513+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bd4063070 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4bc17fa640 1 -- 172.21.15.100:0/1716173327 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4bc809ac70 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 10 client.15483 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56375afd4470 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4bc17fa640 1 -- 172.21.15.100:0/1716173327 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bd4063070 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4bc17fa640 1 -- 172.21.15.100:0/1716173327 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4bc8023060 con 0x56375afcadb0 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 10 client.15483 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:40.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 20 client.15483 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:40.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afd4a40 0x56375afd4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:40.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 4 client.15483 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:07:40.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.514+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56375af2fd70 con 0x56375afd4a40 2024-09-12T02:07:40.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afd4a40 0x56375afd4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:40.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4bc17fa640 10 client.15483 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:40.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4bdde60640 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afd4a40 0x56375afd4e50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57a5b476a1402e41 server_cookie=6d8d2dcfe94266be in_seq=0 out_seq=0 2024-09-12T02:07:40.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4bc17fa640 1 -- 172.21.15.100:0/1716173327 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56375af2fd70 con 0x56375afd4a40 2024-09-12T02:07:40.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4bc17fa640 10 client.15483 handle_command_reply: tid=0 2024-09-12T02:07:40.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4be249d740 1 client.15483 shutdown 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afcadb0 msgr2=0x56375b045370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.515+0000 7f4be249d740 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afcadb0 0x56375b045370 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4bc809ae30 tx=0x7f4bc8009c30 comp rx=0 tx=0).stop 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 shutdown_connections 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56375afd4a40 0x56375afd4e50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56375afcd370 0x56375b0458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56375afcadb0 0x56375b045370 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4bc17fa640 0 client.15483 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 --2- 172.21.15.100:0/1716173327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56375afc3b40 0x56375afc7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 >> 172.21.15.100:0/1716173327 conn(0x56375af8b310 msgr2=0x56375afc4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 shutdown_connections 2024-09-12T02:07:40.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 1 -- 172.21.15.100:0/1716173327 wait complete. 2024-09-12T02:07:40.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.516+0000 7f4be249d740 20 client.15483 trim_cache size 0 max 16384 2024-09-12T02:07:40.520 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4bc40a2c90 msgr2=0x7f4bc40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4bc40a2c90 0x7f4bc40a5150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009900 tx=0x7f4bd40058d0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd81036e0 msgr2=0x7f4bd8198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd81036e0 0x7f4bd8198b20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800d750 tx=0x7f4bc800dc10 comp rx=0 tx=0).stop 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 shutdown_connections 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4bc40a2c90 0x7f4bc40a5150 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd81082a0 0x7f4bd819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd81036e0 0x7f4bd8198b20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 --2- 172.21.15.100:0/1889639342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8102d30 0x7f4bd81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:40.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 >> 172.21.15.100:0/1889639342 conn(0x7f4bd80fc7d0 msgr2=0x7f4bd8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:40.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 shutdown_connections 2024-09-12T02:07:40.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:40.517+0000 7f4be00c4640 1 -- 172.21.15.100:0/1889639342 wait complete. 2024-09-12T02:07:41.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:41 smithi117 ceph-mon[35240]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:41.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:41 smithi100 ceph-mon[31179]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:41 smithi189 ceph-mon[35188]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:07:42.297 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:07:42.298 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:07:42.681 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:43.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 -- 172.21.15.100:0/650665926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c101df0 msgr2=0x7fbe1c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/650665926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c101df0 0x7fbe1c1021d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009900 tx=0x7fbe1802a410 comp rx=0 tx=0).stop 2024-09-12T02:07:43.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 -- 172.21.15.100:0/650665926 shutdown_connections 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/650665926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1c106f20 0x7fbe1c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/650665926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c1027a0 0x7fbe1c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/650665926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c101df0 0x7fbe1c1021d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 -- 172.21.15.100:0/650665926 >> 172.21.15.100:0/650665926 conn(0x7fbe1c0fd8f0 msgr2=0x7fbe1c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 -- 172.21.15.100:0/650665926 shutdown_connections 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.233+0000 7fbe22cf6640 1 -- 172.21.15.100:0/650665926 wait complete. 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.234+0000 7fbe22cf6640 1 Processor -- start 2024-09-12T02:07:43.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.234+0000 7fbe22cf6640 1 -- start start 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.234+0000 7fbe22cf6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c101df0 0x7fbe1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe22cf6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c1027a0 0x7fbe1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe22cf6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1c106f20 0x7fbe1c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe22cf6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c111f40 con 0x7fbe1c1027a0 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe22cf6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c111dc0 con 0x7fbe1c106f20 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe22cf6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1120c0 con 0x7fbe1c101df0 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c101df0 0x7fbe1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c101df0 0x7fbe1c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38852/0 (socket says 172.21.15.100:38852) 2024-09-12T02:07:43.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe20a92640 1 -- 172.21.15.100:0/263985266 learned_addr learned my addr 172.21.15.100:0/263985266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:43.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe21293640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1c106f20 0x7fbe1c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe20a92640 1 -- 172.21.15.100:0/263985266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1c106f20 msgr2=0x7fbe1c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe20a92640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1c106f20 0x7fbe1c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe20a92640 1 -- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c1027a0 msgr2=0x7fbe1c074a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.235+0000 7fbe13fff640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c1027a0 0x7fbe1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe20a92640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c1027a0 0x7fbe1c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe20a92640 1 -- 172.21.15.100:0/263985266 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c1a6880 con 0x7fbe1c101df0 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe13fff640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c1027a0 0x7fbe1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe20a92640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c101df0 0x7fbe1c0744f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe18006010 tx=0x7fbe180042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe11ffb640 1 -- 172.21.15.100:0/263985266 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1803f030 con 0x7fbe1c101df0 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c1a6b10 con 0x7fbe1c101df0 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c1a7040 con 0x7fbe1c101df0 2024-09-12T02:07:43.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe11ffb640 1 -- 172.21.15.100:0/263985266 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe18003ce0 con 0x7fbe1c101df0 2024-09-12T02:07:43.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.236+0000 7fbe11ffb640 1 -- 172.21.15.100:0/263985266 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18049060 con 0x7fbe1c101df0 2024-09-12T02:07:43.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.239+0000 7fbe11ffb640 1 -- 172.21.15.100:0/263985266 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbe18042030 con 0x7fbe1c101df0 2024-09-12T02:07:43.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.239+0000 7fbe11ffb640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbe040a2c10 0x7fbe040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.239+0000 7fbe11ffb640 1 -- 172.21.15.100:0/263985266 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbe180ef540 con 0x7fbe1c101df0 2024-09-12T02:07:43.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.240+0000 7fbe13fff640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbe040a2c10 0x7fbe040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.240+0000 7fbe13fff640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbe040a2c10 0x7fbe040a50d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c075f80 tx=0x7fbe0c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:43.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 Processor -- start 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 -- start start 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879dcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558f87942280 con 0x558f879e7d40 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558f878e9b10 con 0x558f879dcb60 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe250cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558f8793e240 con 0x558f879dd480 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.241+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879dcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879dcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36540/0 (socket says 172.21.15.100:36540) 2024-09-12T02:07:43.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 -- 172.21.15.100:0/1157240275 learned_addr learned my addr 172.21.15.100:0/1157240275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe21293640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe13fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 -- 172.21.15.100:0/1157240275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 msgr2=0x558f879e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 -- 172.21.15.100:0/1157240275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 msgr2=0x558f879ea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 -- 172.21.15.100:0/1157240275 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f878f61f0 con 0x558f879dcb60 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe21293640 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe20a92640 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879dcf40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b8170 tx=0x7fbe18031a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83b2a37a7b7f86b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.242+0000 7fbe02ffd640 1 -- 172.21.15.100:0/1157240275 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18035070 con 0x558f879dcb60 2024-09-12T02:07:43.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.243+0000 7fbe02ffd640 1 -- 172.21.15.100:0/1157240275 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe180d4e50 con 0x558f879dcb60 2024-09-12T02:07:43.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.243+0000 7fbe02ffd640 1 -- 172.21.15.100:0/1157240275 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18003800 con 0x558f879dcb60 2024-09-12T02:07:43.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.243+0000 7fbe250cf740 1 -- 172.21.15.100:0/1157240275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 msgr2=0x558f879dcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.243+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879dcf40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b8170 tx=0x7fbe18031a60 comp rx=0 tx=0).stop 2024-09-12T02:07:43.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 -- 172.21.15.100:0/1157240275 shutdown_connections 2024-09-12T02:07:43.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1157240275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879dcf40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 -- 172.21.15.100:0/1157240275 >> 172.21.15.100:0/1157240275 conn(0x558f879d90f0 msgr2=0x558f879d94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 -- 172.21.15.100:0/1157240275 shutdown_connections 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 -- 172.21.15.100:0/1157240275 wait complete. 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 -- start start 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.244+0000 7fbe250cf740 1 Processor -- start 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879e56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe250cf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558f879ea6d0 con 0x558f879e7d40 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe250cf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558f878fcf10 con 0x558f879dcb60 2024-09-12T02:07:43.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe250cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558f879ea850 con 0x558f879dd480 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe250cf740 10 client.0 _ll_register_callbacks cb 0x558f878c5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe21293640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879e56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879e4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:36544/0 (socket says 172.21.15.100:36544) 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe20a92640 1 -- 172.21.15.100:0/3252071986 learned_addr learned my addr 172.21.15.100:0/3252071986 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe13fff640 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe20a92640 1 -- 172.21.15.100:0/3252071986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 msgr2=0x558f879e51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe20a92640 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.245+0000 7fbe20a92640 1 -- 172.21.15.100:0/3252071986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 msgr2=0x558f879e56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbe20a92640 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879e56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbe20a92640 1 -- 172.21.15.100:0/3252071986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f876b36a0 con 0x558f879dcb60 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbe21293640 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879e56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbe20a92640 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879e4c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe180c4450 tx=0x7fbe180ed380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17732e8438199982 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbdfbfff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbdfbfff640 1 -- 172.21.15.100:0/3252071986 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18035050 con 0x558f879dcb60 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe180d4e50 con 0x558f879dcb60 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbdfbfff640 1 -- 172.21.15.100:0/3252071986 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbe180b8380 con 0x558f879dcb60 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbdfbfff640 1 -- 172.21.15.100:0/3252071986 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe180bbd10 con 0x558f879dcb60 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbe250cf740 10 client.25013 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.246+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558f879ea6d0 con 0x558f879dcb60 2024-09-12T02:07:43.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbdfbfff640 1 -- 172.21.15.100:0/3252071986 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe180d4e50 con 0x558f879dcb60 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbdfbfff640 1 -- 172.21.15.100:0/3252071986 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe1804c060 con 0x558f879dcb60 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbe250cf740 10 client.25013 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbe250cf740 10 client.25013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbe250cf740 20 client.25013 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbe250cf740 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f879f73c0 0x558f879f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbe250cf740 4 client.25013 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f8794f7f0 con 0x558f879f73c0 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbe13fff640 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f879f73c0 0x558f879f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.247+0000 7fbdfbfff640 10 client.25013 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:43.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.248+0000 7fbe13fff640 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f879f73c0 0x558f879f97b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1396e491e0951df3 server_cookie=bbb5db8e51ee306d in_seq=0 out_seq=0 2024-09-12T02:07:43.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbdfbfff640 1 -- 172.21.15.100:0/3252071986 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f8794f7f0 con 0x558f879f73c0 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbdfbfff640 10 client.25013 handle_command_reply: tid=0 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 client.25013 shutdown 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 msgr2=0x558f879e4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879e4c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe180c4450 tx=0x7fbe180ed380 comp rx=0 tx=0).stop 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 shutdown_connections 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f879f73c0 0x558f879f97b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbdfbfff640 0 client.25013 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879e56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879e51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 --2- 172.21.15.100:0/3252071986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879e4c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 >> 172.21.15.100:0/3252071986 conn(0x558f879d90f0 msgr2=0x558f879dedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:43.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 shutdown_connections 2024-09-12T02:07:43.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.249+0000 7fbe250cf740 1 -- 172.21.15.100:0/3252071986 wait complete. 2024-09-12T02:07:43.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.250+0000 7fbe250cf740 20 client.25013 trim_cache size 0 max 16384 2024-09-12T02:07:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.283+0000 7fbe250cf740 1 Processor -- start 2024-09-12T02:07:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe250cf740 1 -- start start 2024-09-12T02:07:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dcb60 0x558f879e6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879dd480 0x558f879fef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879e7d40 0x558f879ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe250cf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1b1f80 con 0x558f879dd480 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe250cf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1af850 con 0x558f879e7d40 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe250cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ad6a0 con 0x558f879dcb60 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe13fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879dd480 0x558f879fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dcb60 0x558f879e6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dcb60 0x558f879e6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38884/0 (socket says 172.21.15.100:38884) 2024-09-12T02:07:43.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.284+0000 7fbe20a92640 1 -- 172.21.15.100:0/1536970640 learned_addr learned my addr 172.21.15.100:0/1536970640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe21293640 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879e7d40 0x558f879ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe20a92640 1 -- 172.21.15.100:0/1536970640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879e7d40 msgr2=0x558f879ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe20a92640 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879e7d40 0x558f879ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe20a92640 1 -- 172.21.15.100:0/1536970640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879dd480 msgr2=0x558f879fef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe20a92640 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879dd480 0x558f879fef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe20a92640 1 -- 172.21.15.100:0/1536970640 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f879dd2b0 con 0x558f879dcb60 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe13fff640 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879dd480 0x558f879fef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:43.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe20a92640 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dcb60 0x558f879e6ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b86e0 tx=0x7fbe180bbc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fda0d8fa9f8abe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe027fc640 1 -- 172.21.15.100:0/1536970640 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18035070 con 0x558f879dcb60 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.285+0000 7fbe027fc640 1 -- 172.21.15.100:0/1536970640 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe180d4e50 con 0x558f879dcb60 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe027fc640 1 -- 172.21.15.100:0/1536970640 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180c4540 con 0x558f879dcb60 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe250cf740 1 -- 172.21.15.100:0/1536970640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dcb60 msgr2=0x558f879e6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dcb60 0x558f879e6ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b86e0 tx=0x7fbe180bbc10 comp rx=0 tx=0).stop 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe250cf740 1 -- 172.21.15.100:0/1536970640 shutdown_connections 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879e7d40 0x558f879ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879dd480 0x558f879fef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe250cf740 1 --2- 172.21.15.100:0/1536970640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dcb60 0x558f879e6ac0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.286+0000 7fbe250cf740 1 -- 172.21.15.100:0/1536970640 >> 172.21.15.100:0/1536970640 conn(0x558f879d90f0 msgr2=0x558f879e63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.287+0000 7fbe250cf740 1 -- 172.21.15.100:0/1536970640 shutdown_connections 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.287+0000 7fbe250cf740 1 -- 172.21.15.100:0/1536970640 wait complete. 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.287+0000 7fbe250cf740 1 -- start start 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.287+0000 7fbe250cf740 1 Processor -- start 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.287+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.287+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879ebf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.287+0000 7fbe250cf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe250cf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1add10 con 0x558f879e7d40 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe13fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879ebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe20a92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe13fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879ebf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:38890/0 (socket says 172.21.15.100:38890) 2024-09-12T02:07:43.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe13fff640 1 -- 172.21.15.100:0/2807677240 learned_addr learned my addr 172.21.15.100:0/2807677240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:43.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1af180 con 0x558f879dcb60 2024-09-12T02:07:43.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe21293640 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ae3e0 con 0x558f879dd480 2024-09-12T02:07:43.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe250cf740 10 client.0 _ll_register_callbacks cb 0x7fbe140099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:43.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe20a92640 1 -- 172.21.15.100:0/2807677240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 msgr2=0x558f879ebf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe20a92640 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879ebf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe20a92640 1 -- 172.21.15.100:0/2807677240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 msgr2=0x558f879ec450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe20a92640 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ec450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe20a92640 1 -- 172.21.15.100:0/2807677240 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f87a611b0 con 0x558f879dcb60 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.288+0000 7fbe21293640 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.289+0000 7fbe20a92640 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879eb9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe18000c00 tx=0x7fbe1802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66bfc4c555216195 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.289+0000 7fbdfbfff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.289+0000 7fbdfbfff640 1 -- 172.21.15.100:0/2807677240 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18035070 con 0x558f879dcb60 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.289+0000 7fbdfbfff640 1 -- 172.21.15.100:0/2807677240 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbe180ef2d0 con 0x558f879dcb60 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.289+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe180d4e50 con 0x558f879dcb60 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbdfbfff640 1 -- 172.21.15.100:0/2807677240 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe180bc410 con 0x558f879dcb60 2024-09-12T02:07:43.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 10 client.25019 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:43.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558f87a611b0 con 0x558f879dcb60 2024-09-12T02:07:43.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbdfbfff640 1 -- 172.21.15.100:0/2807677240 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe180d4e50 con 0x558f879dcb60 2024-09-12T02:07:43.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbdfbfff640 1 -- 172.21.15.100:0/2807677240 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe1803bc10 con 0x558f879dcb60 2024-09-12T02:07:43.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 10 client.25019 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:43.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 10 client.25019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:43.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 20 client.25019 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:43.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f87a62740 0x558f87a64b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:43.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 4 client.25019 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:07:43.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558f87949d00 con 0x558f87a62740 2024-09-12T02:07:43.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.290+0000 7fbe13fff640 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f87a62740 0x558f87a64b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:43.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.291+0000 7fbe13fff640 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f87a62740 0x558f87a64b30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32406200f8c38e22 server_cookie=675b3f4311c144a1 in_seq=0 out_seq=0 2024-09-12T02:07:43.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.291+0000 7fbdfbfff640 10 client.25019 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbdfbfff640 1 -- 172.21.15.100:0/2807677240 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558f87949d00 con 0x558f87a62740 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbdfbfff640 10 client.25019 handle_command_reply: tid=0 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 client.25019 shutdown 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 msgr2=0x558f879eb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879eb9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe18000c00 tx=0x7fbe1802a410 comp rx=0 tx=0).stop 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 shutdown_connections 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x558f87a62740 0x558f87a64b30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f879e7d40 0x558f879ec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558f879dd480 0x558f879ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbdfbfff640 0 client.25019 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 --2- 172.21.15.100:0/2807677240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558f879dcb60 0x558f879eb9d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 >> 172.21.15.100:0/2807677240 conn(0x558f879d90f0 msgr2=0x558f879dedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 shutdown_connections 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 1 -- 172.21.15.100:0/2807677240 wait complete. 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.293+0000 7fbe250cf740 20 client.25019 trim_cache size 0 max 16384 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:07:43.296 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "e63194d9-1379-4a8c-bf65-72d3f0fe5676", 2024-09-12T02:07:43.297 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:07:43.297 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:43.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbe040a2c10 msgr2=0x7fbe040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbe040a2c10 0x7fbe040a50d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c075f80 tx=0x7fbe0c005d90 comp rx=0 tx=0).stop 2024-09-12T02:07:43.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c101df0 msgr2=0x7fbe1c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:43.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c101df0 0x7fbe1c0744f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe18006010 tx=0x7fbe180042f0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 shutdown_connections 2024-09-12T02:07:43.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fbe040a2c10 0x7fbe040a50d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1c106f20 0x7fbe1c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe1c1027a0 0x7fbe1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 --2- 172.21.15.100:0/263985266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe1c101df0 0x7fbe1c0744f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:43.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 >> 172.21.15.100:0/263985266 conn(0x7fbe1c0fd8f0 msgr2=0x7fbe1c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:43.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 shutdown_connections 2024-09-12T02:07:43.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:43.294+0000 7fbe22cf6640 1 -- 172.21.15.100:0/263985266 wait complete. 2024-09-12T02:07:43.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:43 smithi117 ceph-mon[35240]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:07:43.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:43 smithi100 ceph-mon[31179]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:07:43.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:43 smithi189 ceph-mon[35188]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:07:43.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:07:44.141 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:44 smithi100 ceph-mon[31179]: scrub queued for path: / 2024-09-12T02:07:44.141 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:44 smithi100 ceph-mon[31179]: scrub summary: idle+waiting paths [/] 2024-09-12T02:07:44.141 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:44 smithi100 ceph-mon[31179]: scrub summary: active paths [/] 2024-09-12T02:07:44.141 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:44 smithi100 ceph-mon[31179]: scrub summary: idle+waiting paths [/] 2024-09-12T02:07:44.253 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:44 smithi117 ceph-mon[35240]: scrub queued for path: / 2024-09-12T02:07:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:44 smithi117 ceph-mon[35240]: scrub summary: idle+waiting paths [/] 2024-09-12T02:07:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:44 smithi117 ceph-mon[35240]: scrub summary: active paths [/] 2024-09-12T02:07:44.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:44 smithi117 ceph-mon[35240]: scrub summary: idle+waiting paths [/] 2024-09-12T02:07:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:44 smithi189 ceph-mon[35188]: scrub queued for path: / 2024-09-12T02:07:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:44 smithi189 ceph-mon[35188]: scrub summary: idle+waiting paths [/] 2024-09-12T02:07:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:44 smithi189 ceph-mon[35188]: scrub summary: active paths [/] 2024-09-12T02:07:44.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:44 smithi189 ceph-mon[35188]: scrub summary: idle+waiting paths [/] 2024-09-12T02:07:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.791+0000 7ff65ee42640 1 -- 172.21.15.100:0/4161209822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 msgr2=0x7ff65810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.791+0000 7ff65ee42640 1 --2- 172.21.15.100:0/4161209822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 0x7ff65810ec30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff65000f0d0 tx=0x7ff65002e710 comp rx=0 tx=0).stop 2024-09-12T02:07:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.792+0000 7ff65ee42640 1 -- 172.21.15.100:0/4161209822 shutdown_connections 2024-09-12T02:07:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.792+0000 7ff65ee42640 1 --2- 172.21.15.100:0/4161209822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 0x7ff65810ec30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.792+0000 7ff65ee42640 1 --2- 172.21.15.100:0/4161209822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 0x7ff658107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.792+0000 7ff65ee42640 1 --2- 172.21.15.100:0/4161209822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff658102d90 0x7ff658103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.792+0000 7ff65ee42640 1 -- 172.21.15.100:0/4161209822 >> 172.21.15.100:0/4161209822 conn(0x7ff6580fc7d0 msgr2=0x7ff6580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:44.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.792+0000 7ff65ee42640 1 -- 172.21.15.100:0/4161209822 shutdown_connections 2024-09-12T02:07:44.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.792+0000 7ff65ee42640 1 -- 172.21.15.100:0/4161209822 wait complete. 2024-09-12T02:07:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.793+0000 7ff65ee42640 1 Processor -- start 2024-09-12T02:07:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.793+0000 7ff65ee42640 1 -- start start 2024-09-12T02:07:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65ee42640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff658102d90 0x7ff6581a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65ee42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 0x7ff6581a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65ee42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 0x7ff65819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65ee42640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff658118690 con 0x7ff658108290 2024-09-12T02:07:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65ee42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff658118510 con 0x7ff658103740 2024-09-12T02:07:44.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65ee42640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff658118810 con 0x7ff658102d90 2024-09-12T02:07:44.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff657fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 0x7ff6581a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff657fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 0x7ff6581a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:43630/0 (socket says 172.21.15.100:43630) 2024-09-12T02:07:44.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff657fff640 1 -- 172.21.15.100:0/3688074767 learned_addr learned my addr 172.21.15.100:0/3688074767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:44.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65cbde640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff658102d90 0x7ff6581a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff657fff640 1 -- 172.21.15.100:0/3688074767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff658102d90 msgr2=0x7ff6581a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff657fff640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff658102d90 0x7ff6581a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff657fff640 1 -- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 msgr2=0x7ff65819e960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.794+0000 7ff65d3df640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 0x7ff65819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff657fff640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 0x7ff65819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff657fff640 1 -- 172.21.15.100:0/3688074767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65819f090 con 0x7ff658103740 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff65d3df640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 0x7ff65819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff657fff640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 0x7ff6581a4ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9c0 tx=0x7ff64400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff655ffb640 1 -- 172.21.15.100:0/3688074767 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64400cd80 con 0x7ff658103740 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65819f380 con 0x7ff658103740 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff655ffb640 1 -- 172.21.15.100:0/3688074767 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff644005500 con 0x7ff658103740 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff655ffb640 1 -- 172.21.15.100:0/3688074767 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644010690 con 0x7ff658103740 2024-09-12T02:07:44.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.795+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6581ab670 con 0x7ff658103740 2024-09-12T02:07:44.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.798+0000 7ff66121b740 1 Processor -- start 2024-09-12T02:07:44.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.798+0000 7ff66121b740 1 -- start start 2024-09-12T02:07:44.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.798+0000 7ff66121b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c499880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.798+0000 7ff66121b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c499dc0 0x55e05c4a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff66121b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c4a4680 0x55e05c4a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff66121b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e05c3ff2e0 con 0x55e05c4994a0 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff66121b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e05c3a6ce0 con 0x55e05c499dc0 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff66121b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e05c3fb2a0 con 0x55e05c4a4680 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c499880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c499880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48694/0 (socket says 172.21.15.100:48694) 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65cbde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c499dc0 0x55e05c4a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 -- 172.21.15.100:0/1214642903 learned_addr learned my addr 172.21.15.100:0/1214642903 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 -- 172.21.15.100:0/1214642903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c4a4680 msgr2=0x55e05c4a6a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 --2- 172.21.15.100:0/1214642903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c4a4680 0x55e05c4a6a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 -- 172.21.15.100:0/1214642903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c499dc0 msgr2=0x55e05c4a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 --2- 172.21.15.100:0/1214642903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c499dc0 0x55e05c4a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.799+0000 7ff65d3df640 1 -- 172.21.15.100:0/1214642903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05c38b440 con 0x55e05c4994a0 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.800+0000 7ff65d3df640 1 --2- 172.21.15.100:0/1214642903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c499880 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff65000f1f0 tx=0x7ff65000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5967f59c0c86c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.800+0000 7ff642ffd640 1 -- 172.21.15.100:0/1214642903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65003a070 con 0x55e05c4994a0 2024-09-12T02:07:44.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.800+0000 7ff642ffd640 1 -- 172.21.15.100:0/1214642903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff650035600 con 0x55e05c4994a0 2024-09-12T02:07:44.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.800+0000 7ff642ffd640 1 -- 172.21.15.100:0/1214642903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500042a0 con 0x55e05c4994a0 2024-09-12T02:07:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.800+0000 7ff655ffb640 1 -- 172.21.15.100:0/3688074767 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff644010830 con 0x7ff658103740 2024-09-12T02:07:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.800+0000 7ff66121b740 1 -- 172.21.15.100:0/1214642903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 msgr2=0x55e05c499880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.800+0000 7ff66121b740 1 --2- 172.21.15.100:0/1214642903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c499880 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff65000f1f0 tx=0x7ff65000de10 comp rx=0 tx=0).stop 2024-09-12T02:07:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.801+0000 7ff66121b740 1 -- 172.21.15.100:0/1214642903 shutdown_connections 2024-09-12T02:07:44.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.801+0000 7ff66121b740 1 --2- 172.21.15.100:0/1214642903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c4a4680 0x55e05c4a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.801+0000 7ff66121b740 1 --2- 172.21.15.100:0/1214642903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c499dc0 0x55e05c4a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.801+0000 7ff66121b740 1 --2- 172.21.15.100:0/1214642903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c499880 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.801+0000 7ff66121b740 1 -- 172.21.15.100:0/1214642903 >> 172.21.15.100:0/1214642903 conn(0x55e05c495a30 msgr2=0x55e05c495e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.802+0000 7ff66121b740 1 -- 172.21.15.100:0/1214642903 shutdown_connections 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.802+0000 7ff66121b740 1 -- 172.21.15.100:0/1214642903 wait complete. 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.802+0000 7ff655ffb640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff6480a2ba0 0x7ff6480a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.802+0000 7ff66121b740 1 -- start start 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.802+0000 7ff655ffb640 1 -- 172.21.15.100:0/3688074767 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff6440cf630 con 0x7ff658103740 2024-09-12T02:07:44.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.802+0000 7ff66121b740 1 Processor -- start 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.802+0000 7ff65d3df640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff6480a2ba0 0x7ff6480a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff66121b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4994a0 0x55e05c4a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff66121b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff66121b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff66121b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e05c4a71f0 con 0x55e05c4a4680 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff66121b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e05c3ba050 con 0x55e05c4994a0 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff66121b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e05c4a7370 con 0x55e05c499dc0 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff66121b740 10 client.0 _ll_register_callbacks cb 0x55e05c3fa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4994a0 0x55e05c4a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4994a0 0x55e05c4a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:43648/0 (socket says 172.21.15.100:43648) 2024-09-12T02:07:44.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 -- 172.21.15.100:0/633934770 learned_addr learned my addr 172.21.15.100:0/633934770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:44.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65d3df640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff6480a2ba0 0x7ff6480a5060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff65000f0d0 tx=0x7ff65002e710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:44.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65d3df640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff657fff640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 -- 172.21.15.100:0/633934770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 msgr2=0x55e05c4a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 -- 172.21.15.100:0/633934770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 msgr2=0x55e05c4a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 -- 172.21.15.100:0/633934770 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05c1703c0 con 0x55e05c4994a0 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65d3df640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff65cbde640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4994a0 0x55e05c4a4020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff64c012720 tx=0x7ff64c012be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3451e90689ec6858 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.803+0000 7ff637fff640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.804+0000 7ff637fff640 1 -- 172.21.15.100:0/633934770 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c004030 con 0x55e05c4994a0 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.804+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff650035600 con 0x55e05c4994a0 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.804+0000 7ff637fff640 1 -- 172.21.15.100:0/633934770 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff64c0041d0 con 0x55e05c4994a0 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.804+0000 7ff637fff640 1 -- 172.21.15.100:0/633934770 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff64c0043d0 con 0x55e05c4994a0 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.804+0000 7ff66121b740 10 client.25031 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:44.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.804+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e05c4c3ca0 con 0x55e05c4994a0 2024-09-12T02:07:44.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.804+0000 7ff637fff640 1 -- 172.21.15.100:0/633934770 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff650035600 con 0x55e05c4994a0 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff637fff640 1 -- 172.21.15.100:0/633934770 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff64c003c10 con 0x55e05c4994a0 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff66121b740 10 client.25031 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff66121b740 10 client.25031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff66121b740 20 client.25031 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff66121b740 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c4c50b0 0x55e05c4c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff66121b740 4 client.25031 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e05c40c850 con 0x55e05c4c50b0 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff657fff640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c4c50b0 0x55e05c4c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff657fff640 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c4c50b0 0x55e05c4c74a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=546cc82c11e2c49 server_cookie=3a293643e6b0c49 in_seq=0 out_seq=0 2024-09-12T02:07:44.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.805+0000 7ff637fff640 10 client.25031 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff637fff640 1 -- 172.21.15.100:0/633934770 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e05c40c850 con 0x55e05c4c50b0 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff637fff640 10 client.25031 handle_command_reply: tid=0 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 client.25031 shutdown 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4994a0 msgr2=0x55e05c4a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4994a0 0x55e05c4a4020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff64c012720 tx=0x7ff64c012be0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 shutdown_connections 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c4c50b0 0x55e05c4c74a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 --2- 172.21.15.100:0/633934770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4994a0 0x55e05c4a4020 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 >> 172.21.15.100:0/633934770 conn(0x55e05c495a30 msgr2=0x55e05c49b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff637fff640 0 client.25031 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:44.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 shutdown_connections 2024-09-12T02:07:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 1 -- 172.21.15.100:0/633934770 wait complete. 2024-09-12T02:07:44.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.806+0000 7ff66121b740 20 client.25031 trim_cache size 0 max 16384 2024-09-12T02:07:44.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.823+0000 7ff66121b740 1 Processor -- start 2024-09-12T02:07:44.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.823+0000 7ff66121b740 1 -- start start 2024-09-12T02:07:44.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff66121b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c49fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff66121b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff66121b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4a4680 0x55e05c4cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff66121b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff65806df40 con 0x55e05c4994a0 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff66121b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff658117c20 con 0x55e05c4a4680 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff66121b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff658115a70 con 0x55e05c499dc0 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c49fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c49fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48712/0 (socket says 172.21.15.100:48712) 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 -- 172.21.15.100:0/3490248579 learned_addr learned my addr 172.21.15.100:0/3490248579 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65d3df640 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4a4680 0x55e05c4cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff657fff640 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 -- 172.21.15.100:0/3490248579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 msgr2=0x55e05c4ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 -- 172.21.15.100:0/3490248579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4a4680 msgr2=0x55e05c4cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:44.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4a4680 0x55e05c4cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 -- 172.21.15.100:0/3490248579 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05c4a02a0 con 0x55e05c4994a0 2024-09-12T02:07:44.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.824+0000 7ff65cbde640 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c49fbc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0098e0 tx=0x7ff64c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7410291651b4234d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.825+0000 7ff6427fc640 1 -- 172.21.15.100:0/3490248579 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0106f0 con 0x55e05c4994a0 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.825+0000 7ff6427fc640 1 -- 172.21.15.100:0/3490248579 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff64c010890 con 0x55e05c4994a0 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.825+0000 7ff6427fc640 1 -- 172.21.15.100:0/3490248579 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c01c7a0 con 0x55e05c4994a0 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 -- 172.21.15.100:0/3490248579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 msgr2=0x55e05c49fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c49fbc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0098e0 tx=0x7ff64c005d30 comp rx=0 tx=0).stop 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 -- 172.21.15.100:0/3490248579 shutdown_connections 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c4a4680 0x55e05c4cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 --2- 172.21.15.100:0/3490248579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4994a0 0x55e05c49fbc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 -- 172.21.15.100:0/3490248579 >> 172.21.15.100:0/3490248579 conn(0x55e05c495a30 msgr2=0x55e05c49c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:44.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 -- 172.21.15.100:0/3490248579 shutdown_connections 2024-09-12T02:07:44.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 -- 172.21.15.100:0/3490248579 wait complete. 2024-09-12T02:07:44.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.826+0000 7ff66121b740 1 -- start start 2024-09-12T02:07:44.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 1 Processor -- start 2024-09-12T02:07:44.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff657fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff657fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48724/0 (socket says 172.21.15.100:48724) 2024-09-12T02:07:44.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c52cce0 0x55e05c52f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581160e0 con 0x55e05c4a4680 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff658117550 con 0x55e05c52cce0 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581167b0 con 0x55e05c499dc0 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff66121b740 10 client.0 _ll_register_callbacks cb 0x7ff64c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.827+0000 7ff657fff640 1 -- 172.21.15.100:0/4265690066 learned_addr learned my addr 172.21.15.100:0/4265690066 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff65d3df640 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c52cce0 0x55e05c52f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff65cbde640 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff657fff640 1 -- 172.21.15.100:0/4265690066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 msgr2=0x55e05c4a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff657fff640 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff657fff640 1 -- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c52cce0 msgr2=0x55e05c52f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff657fff640 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c52cce0 0x55e05c52f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff657fff640 1 -- 172.21.15.100:0/4265690066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05c4a4390 con 0x55e05c4a4680 2024-09-12T02:07:44.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff657fff640 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4aa0d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff6440986b0 tx=0x7ff64409bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bf3e8312477df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff637fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff637fff640 1 -- 172.21.15.100:0/4265690066 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6440a4950 con 0x55e05c4a4680 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff637fff640 1 -- 172.21.15.100:0/4265690066 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff6440046c0 con 0x55e05c4a4680 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.828+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff64c010890 con 0x55e05c4a4680 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff637fff640 1 -- 172.21.15.100:0/4265690066 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6440cd1e0 con 0x55e05c4a4680 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 10 client.15510 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e05c530800 con 0x55e05c4a4680 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff637fff640 1 -- 172.21.15.100:0/4265690066 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff64c010890 con 0x55e05c4a4680 2024-09-12T02:07:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff637fff640 1 -- 172.21.15.100:0/4265690066 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff64407ab50 con 0x55e05c4a4680 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 10 client.15510 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 20 client.15510 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c530f30 0x55e05c533350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 4 client.15510 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.829+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e05c406d60 con 0x55e05c530f30 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.830+0000 7ff65cbde640 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c530f30 0x55e05c533350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.830+0000 7ff637fff640 10 client.15510 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.830+0000 7ff65cbde640 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c530f30 0x55e05c533350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e14cd31d7399de server_cookie=fa79a9c8a910c22a in_seq=0 out_seq=0 2024-09-12T02:07:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff637fff640 1 -- 172.21.15.100:0/4265690066 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e05c406d60 con 0x55e05c530f30 2024-09-12T02:07:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff637fff640 10 client.15510 handle_command_reply: tid=0 2024-09-12T02:07:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 client.15510 shutdown 2024-09-12T02:07:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 msgr2=0x55e05c4aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4aa0d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff6440986b0 tx=0x7ff64409bda0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 shutdown_connections 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55e05c530f30 0x55e05c533350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e05c52cce0 0x55e05c52f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff637fff640 0 client.15510 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e05c4a4680 0x55e05c4aa0d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 --2- 172.21.15.100:0/4265690066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e05c499dc0 0x55e05c4a9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 >> 172.21.15.100:0/4265690066 conn(0x55e05c495a30 msgr2=0x55e05c49c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 shutdown_connections 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 1 -- 172.21.15.100:0/4265690066 wait complete. 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.831+0000 7ff66121b740 20 client.15510 trim_cache size 0 max 16384 2024-09-12T02:07:44.835 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: "e63194d9-1379-4a8c-bf65-72d3f0fe5676": { 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "e63194d9-1379-4a8c-bf65-72d3f0fe5676", 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:44.836 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff6480a2ba0 msgr2=0x7ff6480a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff6480a2ba0 0x7ff6480a5060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff65000f0d0 tx=0x7ff65002e710 comp rx=0 tx=0).stop 2024-09-12T02:07:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 msgr2=0x7ff6581a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 0x7ff6581a4ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9c0 tx=0x7ff64400ee80 comp rx=0 tx=0).stop 2024-09-12T02:07:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 shutdown_connections 2024-09-12T02:07:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7ff6480a2ba0 0x7ff6480a5060 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658108290 0x7ff65819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658103740 0x7ff6581a4ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 --2- 172.21.15.100:0/3688074767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff658102d90 0x7ff6581a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:44.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.832+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 >> 172.21.15.100:0/3688074767 conn(0x7ff6580fc7d0 msgr2=0x7ff658105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:44.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.833+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 shutdown_connections 2024-09-12T02:07:44.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:44.833+0000 7ff65ee42640 1 -- 172.21.15.100:0/3688074767 wait complete. 2024-09-12T02:07:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:45 smithi117 ceph-mon[35240]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:07:45.519 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:45 smithi100 ceph-mon[31179]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:07:45.551 INFO:tasks.cephfs.filesystem:scrub status for tag:e63194d9-1379-4a8c-bf65-72d3f0fe5676 - {'path': '/', 'tag': 'e63194d9-1379-4a8c-bf65-72d3f0fe5676', 'options': 'recursive,force'} 2024-09-12T02:07:45.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:45 smithi189 ceph-mon[35188]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.053+0000 7f0893a8d640 1 -- 172.21.15.100:0/3401216267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c102d50 msgr2=0x7f088c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.053+0000 7f0893a8d640 1 --2- 172.21.15.100:0/3401216267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c102d50 0x7f088c1031d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f087c009900 tx=0x7f087c02a410 comp rx=0 tx=0).stop 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.053+0000 7f0893a8d640 1 -- 172.21.15.100:0/3401216267 shutdown_connections 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.053+0000 7f0893a8d640 1 --2- 172.21.15.100:0/3401216267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f088c103710 0x7f088c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.053+0000 7f0893a8d640 1 --2- 172.21.15.100:0/3401216267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c102d50 0x7f088c1031d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.053+0000 7f0893a8d640 1 --2- 172.21.15.100:0/3401216267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088c101b60 0x7f088c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.053+0000 7f0893a8d640 1 -- 172.21.15.100:0/3401216267 >> 172.21.15.100:0/3401216267 conn(0x7f088c0fd2e0 msgr2=0x7f088c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.054+0000 7f0893a8d640 1 -- 172.21.15.100:0/3401216267 shutdown_connections 2024-09-12T02:07:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.054+0000 7f0893a8d640 1 -- 172.21.15.100:0/3401216267 wait complete. 2024-09-12T02:07:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.054+0000 7f0893a8d640 1 Processor -- start 2024-09-12T02:07:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.054+0000 7f0893a8d640 1 -- start start 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0893a8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c101b60 0x7f088c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0893a8d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088c102d50 0x7f088c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0893a8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f088c103710 0x7f088c19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0893a8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f088c10d830 con 0x7f088c101b60 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0893a8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f088c10d6b0 con 0x7f088c103710 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0893a8d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f088c10d9b0 con 0x7f088c102d50 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c101b60 0x7f088c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c101b60 0x7f088c197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48730/0 (socket says 172.21.15.100:48730) 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 -- 172.21.15.100:0/2559452629 learned_addr learned my addr 172.21.15.100:0/2559452629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891028640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088c102d50 0x7f088c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 -- 172.21.15.100:0/2559452629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088c102d50 msgr2=0x7f088c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088c102d50 0x7f088c198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 -- 172.21.15.100:0/2559452629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f088c103710 msgr2=0x7f088c19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f088c103710 0x7f088c19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 -- 172.21.15.100:0/2559452629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c19fa40 con 0x7f088c101b60 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891028640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088c102d50 0x7f088c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.055+0000 7f0891829640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c101b60 0x7f088c197e20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f088800d950 tx=0x7f088800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.056+0000 7f0882ffd640 1 -- 172.21.15.100:0/2559452629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888017070 con 0x7f088c101b60 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.056+0000 7f0882ffd640 1 -- 172.21.15.100:0/2559452629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0888009c30 con 0x7f088c101b60 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.056+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088c19fd30 con 0x7f088c101b60 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.056+0000 7f0882ffd640 1 -- 172.21.15.100:0/2559452629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088800f600 con 0x7f088c101b60 2024-09-12T02:07:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.056+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088c1a01a0 con 0x7f088c101b60 2024-09-12T02:07:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.058+0000 7f0882ffd640 1 -- 172.21.15.100:0/2559452629 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f088801a070 con 0x7f088c101b60 2024-09-12T02:07:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.059+0000 7f0882ffd640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08780a2d50 0x7f08780a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.059+0000 7f0896828740 1 Processor -- start 2024-09-12T02:07:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.059+0000 7f0882ffd640 1 -- 172.21.15.100:0/2559452629 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f08880cecc0 con 0x7f088c101b60 2024-09-12T02:07:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.059+0000 7f0891028640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08780a2d50 0x7f08780a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0896828740 1 -- start start 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0896828740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0896828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 0x55a22f1d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0896828740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0896828740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a22f1342f0 con 0x55a22f1d4330 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0896828740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a22f0dc270 con 0x55a22f1d0920 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0896828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a22f1302b0 con 0x55a22f1d1260 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f089202a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:43684/0 (socket says 172.21.15.100:43684) 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 -- 172.21.15.100:0/3598038673 learned_addr learned my addr 172.21.15.100:0/3598038673 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891028640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08780a2d50 0x7f08780a5210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f087c006010 tx=0x7f087c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 -- 172.21.15.100:0/3598038673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 msgr2=0x55a22f1d3d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 0x55a22f1d3d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 -- 172.21.15.100:0/3598038673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 msgr2=0x55a22f1e12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f0891829640 1 -- 172.21.15.100:0/3598038673 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22f0db340 con 0x55a22f1d0920 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.060+0000 7f089202a640 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.061+0000 7f0891829640 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1d0d20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f088809b360 tx=0x7f0888009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=557edb4420e08bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.061+0000 7f0877fff640 1 -- 172.21.15.100:0/3598038673 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888021050 con 0x55a22f1d0920 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.061+0000 7f0877fff640 1 -- 172.21.15.100:0/3598038673 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08880a4040 con 0x55a22f1d0920 2024-09-12T02:07:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.061+0000 7f0877fff640 1 -- 172.21.15.100:0/3598038673 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088809aa80 con 0x55a22f1d0920 2024-09-12T02:07:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.061+0000 7f0896828740 1 -- 172.21.15.100:0/3598038673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 msgr2=0x55a22f1d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1d0d20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f088809b360 tx=0x7f0888009ee0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 -- 172.21.15.100:0/3598038673 shutdown_connections 2024-09-12T02:07:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 0x55a22f1d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 --2- 172.21.15.100:0/3598038673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1d0d20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 -- 172.21.15.100:0/3598038673 >> 172.21.15.100:0/3598038673 conn(0x55a22f1cc010 msgr2=0x55a22f1cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 -- 172.21.15.100:0/3598038673 shutdown_connections 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 -- 172.21.15.100:0/3598038673 wait complete. 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 -- start start 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 Processor -- start 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.062+0000 7f0896828740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1dac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0896828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 0x55a22f1db170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0896828740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0896828740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a22f1d4dd0 con 0x55a22f1d4330 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0896828740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a22f0bd290 con 0x55a22f1d0920 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0896828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a22f1d4f50 con 0x55a22f1d1260 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1dac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:43696/0 (socket says 172.21.15.100:43696) 2024-09-12T02:07:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 -- 172.21.15.100:0/3634980394 learned_addr learned my addr 172.21.15.100:0/3634980394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0896828740 10 client.0 _ll_register_callbacks cb 0x55a22f0ee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f089202a640 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 -- 172.21.15.100:0/3634980394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 msgr2=0x55a22f1db170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 0x55a22f1db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 -- 172.21.15.100:0/3634980394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 msgr2=0x55a22f1e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 -- 172.21.15.100:0/3634980394 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a22ee47210 con 0x55a22f1d0920 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f089202a640 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.063+0000 7f0891829640 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1dac30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f088809b0d0 tx=0x7f0888009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70313eb821560483 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f08757fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f08757fa640 1 -- 172.21.15.100:0/3634980394 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088809ab50 con 0x55a22f1d0920 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f08757fa640 1 -- 172.21.15.100:0/3634980394 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0888097330 con 0x55a22f1d0920 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08880a4040 con 0x55a22f1d0920 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f08757fa640 1 -- 172.21.15.100:0/3634980394 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f08880b4260 con 0x55a22f1d0920 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 10 client.25046 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a22ef13620 con 0x55a22f1d0920 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f08757fa640 1 -- 172.21.15.100:0/3634980394 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08880a4040 con 0x55a22f1d0920 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f08757fa640 1 -- 172.21.15.100:0/3634980394 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f08880bb080 con 0x55a22f1d0920 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 10 client.25046 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 10 client.25046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 20 client.25046 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f1f74b0 0x55a22f1f98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.065+0000 7f0896828740 4 client.25046 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.066+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a22f141a20 con 0x55a22f1f74b0 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.066+0000 7f0891028640 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f1f74b0 0x55a22f1f98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.067+0000 7f0891028640 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f1f74b0 0x55a22f1f98a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1800a8e74a1e1a server_cookie=5f17d990b13b7f0e in_seq=0 out_seq=0 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.067+0000 7f08757fa640 10 client.25046 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f08757fa640 1 -- 172.21.15.100:0/3634980394 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a22f141a20 con 0x55a22f1f74b0 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f08757fa640 10 client.25046 handle_command_reply: tid=0 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 client.25046 shutdown 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 msgr2=0x55a22f1dac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1dac30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f088809b0d0 tx=0x7f0888009f50 comp rx=0 tx=0).stop 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 shutdown_connections 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f1f74b0 0x55a22f1f98a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d4330 0x55a22f1e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d1260 0x55a22f1db170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f08757fa640 0 client.25046 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 --2- 172.21.15.100:0/3634980394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d0920 0x55a22f1dac30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 >> 172.21.15.100:0/3634980394 conn(0x55a22f1cc010 msgr2=0x55a22f1cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 shutdown_connections 2024-09-12T02:07:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 1 -- 172.21.15.100:0/3634980394 wait complete. 2024-09-12T02:07:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.068+0000 7f0896828740 20 client.25046 trim_cache size 0 max 16384 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 Processor -- start 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 -- start start 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d0920 0x55a22f1d9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d1260 0x55a22f1ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d4330 0x55a22f1cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1a9730 con 0x55a22f1d1260 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1a7000 con 0x55a22f1d4330 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0896828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1a4e50 con 0x55a22f1d0920 2024-09-12T02:07:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d1260 0x55a22f1ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d1260 0x55a22f1ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48756/0 (socket says 172.21.15.100:48756) 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 -- 172.21.15.100:0/355562241 learned_addr learned my addr 172.21.15.100:0/355562241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f089202a640 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d4330 0x55a22f1cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891829640 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d0920 0x55a22f1d9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 -- 172.21.15.100:0/355562241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d0920 msgr2=0x55a22f1d9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d0920 0x55a22f1d9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 -- 172.21.15.100:0/355562241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d4330 msgr2=0x55a22f1cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d4330 0x55a22f1cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.083+0000 7f0891028640 1 -- 172.21.15.100:0/355562241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22f1f9e80 con 0x55a22f1d1260 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.084+0000 7f0891028640 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d1260 0x55a22f1ccec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f087c031440 tx=0x7f087c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce6bf34ee8dd0ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.084+0000 7f08777fe640 1 -- 172.21.15.100:0/355562241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c035050 con 0x55a22f1d1260 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.084+0000 7f08777fe640 1 -- 172.21.15.100:0/355562241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f087c0326c0 con 0x55a22f1d1260 2024-09-12T02:07:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.084+0000 7f08777fe640 1 -- 172.21.15.100:0/355562241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0046c0 con 0x55a22f1d1260 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 -- 172.21.15.100:0/355562241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d1260 msgr2=0x55a22f1ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d1260 0x55a22f1ccec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f087c031440 tx=0x7f087c02a410 comp rx=0 tx=0).stop 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 -- 172.21.15.100:0/355562241 shutdown_connections 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f1d4330 0x55a22f1cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d1260 0x55a22f1ccec0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 --2- 172.21.15.100:0/355562241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d0920 0x55a22f1d9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 -- 172.21.15.100:0/355562241 >> 172.21.15.100:0/355562241 conn(0x55a22f1cc010 msgr2=0x55a22f1db050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 -- 172.21.15.100:0/355562241 shutdown_connections 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 -- 172.21.15.100:0/355562241 wait complete. 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 -- start start 2024-09-12T02:07:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.085+0000 7f0896828740 1 Processor -- start 2024-09-12T02:07:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0896828740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d0920 0x55a22f208e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0896828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d4330 0x55a22f2093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0896828740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f20a380 0x55a22f20a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0896828740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1a54c0 con 0x55a22f1d0920 2024-09-12T02:07:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0896828740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1a6930 con 0x55a22f20a380 2024-09-12T02:07:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0896828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1a5b90 con 0x55a22f1d4330 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0896828740 10 client.0 _ll_register_callbacks cb 0x7f0884009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d0920 0x55a22f208e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d0920 0x55a22f208e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48760/0 (socket says 172.21.15.100:48760) 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 -- 172.21.15.100:0/3969245277 learned_addr learned my addr 172.21.15.100:0/3969245277 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891028640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d4330 0x55a22f2093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f089202a640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f20a380 0x55a22f20a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 -- 172.21.15.100:0/3969245277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d4330 msgr2=0x55a22f2093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d4330 0x55a22f2093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 -- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f20a380 msgr2=0x55a22f20a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f20a380 0x55a22f20a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 -- 172.21.15.100:0/3969245277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a22f20ad70 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891028640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d4330 0x55a22f2093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f0891829640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d0920 0x55a22f208e80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0888097830 tx=0x7f0888009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0f228a5b0e4090 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.086+0000 7f08757fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f08757fa640 1 -- 172.21.15.100:0/3969245277 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888021070 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f08757fa640 1 -- 172.21.15.100:0/3969245277 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f088809aa30 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087c0326c0 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f08757fa640 1 -- 172.21.15.100:0/3969245277 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0888097670 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f0896828740 10 client.15528 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a22f262370 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f08757fa640 1 -- 172.21.15.100:0/3969245277 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08880a4040 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.087+0000 7f08757fa640 1 -- 172.21.15.100:0/3969245277 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f08880a0910 con 0x55a22f1d0920 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0896828740 10 client.15528 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0896828740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0896828740 20 client.15528 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0896828740 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f262ae0 0x55a22f264f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0896828740 4 client.15528 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:07:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f087c0326c0 con 0x55a22f262ae0 2024-09-12T02:07:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0891028640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f262ae0 0x55a22f264f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f08757fa640 10 client.15528 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.088+0000 7f0891028640 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f262ae0 0x55a22f264f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e003c20e2d66f9f7 server_cookie=1155894b47fba5c2 in_seq=0 out_seq=0 2024-09-12T02:07:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f08757fa640 1 -- 172.21.15.100:0/3969245277 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f087c0326c0 con 0x55a22f262ae0 2024-09-12T02:07:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f08757fa640 10 client.15528 handle_command_reply: tid=0 2024-09-12T02:07:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 client.15528 shutdown 2024-09-12T02:07:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d0920 msgr2=0x55a22f208e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d0920 0x55a22f208e80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0888097830 tx=0x7f0888009ee0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 shutdown_connections 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55a22f262ae0 0x55a22f264f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a22f20a380 0x55a22f20a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a22f1d4330 0x55a22f2093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f08757fa640 0 client.15528 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 --2- 172.21.15.100:0/3969245277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a22f1d0920 0x55a22f208e80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 >> 172.21.15.100:0/3969245277 conn(0x55a22f1cc010 msgr2=0x55a22f1cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 shutdown_connections 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 1 -- 172.21.15.100:0/3969245277 wait complete. 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.096+0000 7f0896828740 20 client.15528 trim_cache size 0 max 16384 2024-09-12T02:07:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-09-12T02:07:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-09-12T02:07:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-09-12T02:07:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-09-12T02:07:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08780a2d50 msgr2=0x7f08780a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08780a2d50 0x7f08780a5210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f087c006010 tx=0x7f087c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c101b60 msgr2=0x7f088c197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c101b60 0x7f088c197e20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f088800d950 tx=0x7f088800de10 comp rx=0 tx=0).stop 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 shutdown_connections 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f08780a2d50 0x7f08780a5210 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f088c103710 0x7f088c19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f088c102d50 0x7f088c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 --2- 172.21.15.100:0/2559452629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f088c101b60 0x7f088c197e20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 >> 172.21.15.100:0/2559452629 conn(0x7f088c0fd2e0 msgr2=0x7f088c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 shutdown_connections 2024-09-12T02:07:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:46.097+0000 7f0893a8d640 1 -- 172.21.15.100:0/2559452629 wait complete. 2024-09-12T02:07:47.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:47 smithi117 ceph-mon[35240]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-12T02:07:47.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:47 smithi117 ceph-mon[35240]: scrub summary: idle 2024-09-12T02:07:47.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:47 smithi100 ceph-mon[31179]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-12T02:07:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:47 smithi100 ceph-mon[31179]: scrub summary: idle 2024-09-12T02:07:47.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:47 smithi189 ceph-mon[35188]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-12T02:07:47.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:47 smithi189 ceph-mon[35188]: scrub summary: idle 2024-09-12T02:07:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:49 smithi117 ceph-mon[35240]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:07:49.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:49 smithi100 ceph-mon[31179]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:07:49.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:49 smithi189 ceph-mon[35188]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T02:07:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:51 smithi117 ceph-mon[35240]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:07:51.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:51 smithi100 ceph-mon[31179]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:07:51.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:51 smithi189 ceph-mon[35188]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:07:52.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:07:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:53.464 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:53 smithi100 ceph-mon[31179]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:07:53.464 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:53 smithi100 ceph-mon[31179]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T02:07:53.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 -- 172.21.15.100:0/3586556673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31981036e0 msgr2=0x7f3198107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:53.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 --2- 172.21.15.100:0/3586556673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31981036e0 0x7f3198107b90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f318c009930 tx=0x7f318c02a420 comp rx=0 tx=0).stop 2024-09-12T02:07:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 -- 172.21.15.100:0/3586556673 shutdown_connections 2024-09-12T02:07:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 --2- 172.21.15.100:0/3586556673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31981082a0 0x7f319810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 --2- 172.21.15.100:0/3586556673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31981036e0 0x7f3198107b90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 --2- 172.21.15.100:0/3586556673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198102d30 0x7f3198103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 -- 172.21.15.100:0/3586556673 >> 172.21.15.100:0/3586556673 conn(0x7f31980fc7d0 msgr2=0x7f31980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 -- 172.21.15.100:0/3586556673 shutdown_connections 2024-09-12T02:07:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.567+0000 7f319d610640 1 -- 172.21.15.100:0/3586556673 wait complete. 2024-09-12T02:07:53.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.568+0000 7f319d610640 1 Processor -- start 2024-09-12T02:07:53.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.568+0000 7f319d610640 1 -- start start 2024-09-12T02:07:53.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f319d610640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3198102d30 0x7f3198198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:53.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f319d610640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31981036e0 0x7f3198198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:53.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f319d610640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31981082a0 0x7f319819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:53.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f319d610640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3198112090 con 0x7f3198102d30 2024-09-12T02:07:53.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f319d610640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3198111f10 con 0x7f31981036e0 2024-09-12T02:07:53.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f319d610640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3198112210 con 0x7f31981082a0 2024-09-12T02:07:53.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f3196ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3198102d30 0x7f3198198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:53.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31981036e0 0x7f3198198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:53.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31981036e0 0x7f3198198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:55704/0 (socket says 172.21.15.100:55704) 2024-09-12T02:07:53.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 -- 172.21.15.100:0/919270860 learned_addr learned my addr 172.21.15.100:0/919270860 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 -- 172.21.15.100:0/919270860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31981082a0 msgr2=0x7f319819cce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31981082a0 0x7f319819cce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 -- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3198102d30 msgr2=0x7f3198198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3198102d30 0x7f3198198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.569+0000 7f31967fc640 1 -- 172.21.15.100:0/919270860 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319819d3c0 con 0x7f31981036e0 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.570+0000 7f3196ffd640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3198102d30 0x7f3198198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.570+0000 7f31967fc640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31981036e0 0x7f3198198950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f318c02a940 tx=0x7f318c0309c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:53.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.570+0000 7f317ffff640 1 -- 172.21.15.100:0/919270860 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c03f070 con 0x7f31981036e0 2024-09-12T02:07:53.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.570+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319819d650 con 0x7f31981036e0 2024-09-12T02:07:53.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.570+0000 7f317ffff640 1 -- 172.21.15.100:0/919270860 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f318c030dc0 con 0x7f31981036e0 2024-09-12T02:07:53.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.570+0000 7f317ffff640 1 -- 172.21.15.100:0/919270860 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c035030 con 0x7f31981036e0 2024-09-12T02:07:53.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.570+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31981a4f90 con 0x7f31981036e0 2024-09-12T02:07:53.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.572+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319806a850 con 0x7f31981036e0 2024-09-12T02:07:53.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.573+0000 7f317ffff640 1 -- 172.21.15.100:0/919270860 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f318c042070 con 0x7f31981036e0 2024-09-12T02:07:53.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.574+0000 7f317ffff640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f31800a2c00 0x7f31800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:53.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.574+0000 7f3196ffd640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f31800a2c00 0x7f31800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:53.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.574+0000 7f317ffff640 1 -- 172.21.15.100:0/919270860 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f318c0efca0 con 0x7f31981036e0 2024-09-12T02:07:53.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.574+0000 7f3196ffd640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f31800a2c00 0x7f31800a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3188009cd0 tx=0x7f3188005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:53.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.578+0000 7f317ffff640 1 -- 172.21.15.100:0/919270860 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f318c0bcbb0 con 0x7f31981036e0 2024-09-12T02:07:53.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:53 smithi189 ceph-mon[35188]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:07:53.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:53 smithi189 ceph-mon[35188]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T02:07:53.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:53 smithi117 ceph-mon[35240]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:07:53.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:53 smithi117 ceph-mon[35240]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T02:07:53.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.786+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31981a5190 con 0x7f31981036e0 2024-09-12T02:07:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.788+0000 7f317ffff640 1 -- 172.21.15.100:0/919270860 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7f318c0bc4b0 con 0x7f31981036e0 2024-09-12T02:07:53.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:07:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:07:53.789 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f31800a2c00 msgr2=0x7f31800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f31800a2c00 0x7f31800a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3188009cd0 tx=0x7f3188005f90 comp rx=0 tx=0).stop 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31981036e0 msgr2=0x7f3198198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31981036e0 0x7f3198198950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f318c02a940 tx=0x7f318c0309c0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 shutdown_connections 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f31800a2c00 0x7f31800a50c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f31981082a0 0x7f319819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31981036e0 0x7f3198198950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 --2- 172.21.15.100:0/919270860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3198102d30 0x7f3198198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.791+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 >> 172.21.15.100:0/919270860 conn(0x7f31980fc7d0 msgr2=0x7f31980fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.792+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 shutdown_connections 2024-09-12T02:07:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:53.792+0000 7f319d610640 1 -- 172.21.15.100:0/919270860 wait complete. 2024-09-12T02:07:54.413 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db --set-id bf6ca43f --release --await' 2024-09-12T02:07:54.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db --set-id bf6ca43f --release --await 2024-09-12T02:07:54.435 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:54 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/919270860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:54.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:54 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/919270860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:54.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:54 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/919270860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:07:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.163+0000 7f90de375640 1 -- 172.21.15.100:0/1207829232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 msgr2=0x7f90d810bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.163+0000 7f90de375640 1 --2- 172.21.15.100:0/1207829232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d810bb40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009900 tx=0x7f90cc02a480 comp rx=0 tx=0).stop 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.164+0000 7f90de375640 1 -- 172.21.15.100:0/1207829232 shutdown_connections 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.164+0000 7f90de375640 1 --2- 172.21.15.100:0/1207829232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90d810c160 0x7f90d810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.164+0000 7f90de375640 1 --2- 172.21.15.100:0/1207829232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d810bb40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.164+0000 7f90de375640 1 --2- 172.21.15.100:0/1207829232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 0x7f90d8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.164+0000 7f90de375640 1 -- 172.21.15.100:0/1207829232 >> 172.21.15.100:0/1207829232 conn(0x7f90d80fc790 msgr2=0x7f90d80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.164+0000 7f90de375640 1 -- 172.21.15.100:0/1207829232 shutdown_connections 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.164+0000 7f90de375640 1 -- 172.21.15.100:0/1207829232 wait complete. 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.165+0000 7f90de375640 1 Processor -- start 2024-09-12T02:07:55.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.165+0000 7f90de375640 1 -- start start 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.165+0000 7f90de375640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 0x7f90d8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.165+0000 7f90de375640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.165+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d8198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59804/0 (socket says 172.21.15.100:59804) 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90de375640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90d810c160 0x7f90d819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 0x7f90d8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 0x7f90d8198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:55728/0 (socket says 172.21.15.100:55728) 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d77fe640 1 -- 172.21.15.100:0/3678000157 learned_addr learned my addr 172.21.15.100:0/3678000157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90d8111f60 con 0x7f90d8103650 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90d8111de0 con 0x7f90d8102d30 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90d81120e0 con 0x7f90d810c160 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90dc912640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90d810c160 0x7f90d819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d77fe640 1 -- 172.21.15.100:0/3678000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90d810c160 msgr2=0x7f90d819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d77fe640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90d810c160 0x7f90d819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d77fe640 1 -- 172.21.15.100:0/3678000157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 msgr2=0x7f90d8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d77fe640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 0x7f90d8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d77fe640 1 -- 172.21.15.100:0/3678000157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d819d3f0 con 0x7f90d8103650 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.166+0000 7f90d7fff640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 0x7f90d8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.167+0000 7f90d77fe640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d8198980 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f90cc006010 tx=0x7f90cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.167+0000 7f90d57fa640 1 -- 172.21.15.100:0/3678000157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc048070 con 0x7f90d8103650 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.167+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d819d680 con 0x7f90d8103650 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.167+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d81008c0 con 0x7f90d8103650 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.167+0000 7f90d57fa640 1 -- 172.21.15.100:0/3678000157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90cc03ab50 con 0x7f90d8103650 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.167+0000 7f90d57fa640 1 -- 172.21.15.100:0/3678000157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc035050 con 0x7f90d8103650 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.169+0000 7f90d57fa640 1 -- 172.21.15.100:0/3678000157 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f90cc04b070 con 0x7f90d8103650 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.170+0000 7f90d57fa640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f90c00a2c00 0x7f90c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.170+0000 7f90d57fa640 1 -- 172.21.15.100:0/3678000157 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f90cc0f2f30 con 0x7f90d8103650 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.170+0000 7f90d7fff640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f90c00a2c00 0x7f90c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.170+0000 7f90e074e740 1 Processor -- start 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.170+0000 7f90e074e740 1 -- start start 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d7fff640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f90c00a2c00 0x7f90c00a50c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f90c80058c0 tx=0x7f90c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90e074e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f060 0x562f4008f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90e074e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40099d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90e074e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4009a240 0x562f4009c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90e074e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f3fff4620 con 0x562f4008f980 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90e074e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562f3ff9be50 con 0x562f4008f060 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90e074e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562f3fff05e0 con 0x562f4009a240 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40099d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59812/0 (socket says 172.21.15.100:59812) 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 -- 172.21.15.100:0/2562286472 learned_addr learned my addr 172.21.15.100:0/2562286472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:55.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d7fff640 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f060 0x562f4008f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90dc912640 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4009a240 0x562f4009c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 -- 172.21.15.100:0/2562286472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4009a240 msgr2=0x562f4009c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4009a240 0x562f4009c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 -- 172.21.15.100:0/2562286472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f060 msgr2=0x562f4008f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f060 0x562f4008f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 -- 172.21.15.100:0/2562286472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3ff8cd40 con 0x562f4008f980 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d7fff640 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f060 0x562f4008f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.171+0000 7f90d77fe640 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40099d00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0bd1a0 tx=0x7f90cc0c0310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170d2706e4c63652 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.172+0000 7f90dc912640 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4009a240 0x562f4009c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.172+0000 7f90be7fc640 1 -- 172.21.15.100:0/2562286472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0c0ed0 con 0x562f4008f980 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.172+0000 7f90be7fc640 1 -- 172.21.15.100:0/2562286472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90cc0c07d0 con 0x562f4008f980 2024-09-12T02:07:55.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.172+0000 7f90be7fc640 1 -- 172.21.15.100:0/2562286472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0ab0b0 con 0x562f4008f980 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 -- 172.21.15.100:0/2562286472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 msgr2=0x562f40099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40099d00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0bd1a0 tx=0x7f90cc0c0310 comp rx=0 tx=0).stop 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 -- 172.21.15.100:0/2562286472 shutdown_connections 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4009a240 0x562f4009c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40099d00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 --2- 172.21.15.100:0/2562286472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f060 0x562f4008f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 -- 172.21.15.100:0/2562286472 >> 172.21.15.100:0/2562286472 conn(0x562f4008b5f0 msgr2=0x562f4008b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 -- 172.21.15.100:0/2562286472 shutdown_connections 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 -- 172.21.15.100:0/2562286472 wait complete. 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 -- start start 2024-09-12T02:07:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.173+0000 7f90e074e740 1 Processor -- start 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90e074e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90e074e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40097610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90e074e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 0x562f40097b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90e074e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f4009cbd0 con 0x562f4008f980 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90e074e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562f3ff7cf10 con 0x562f4009a240 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90e074e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562f4009cd50 con 0x562f4008f060 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40097610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90e074e740 10 client.0 _ll_register_callbacks cb 0x562f3ffa0db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40097610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59826/0 (socket says 172.21.15.100:59826) 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90d77fe640 1 -- 172.21.15.100:0/4219201975 learned_addr learned my addr 172.21.15.100:0/4219201975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.174+0000 7f90dc912640 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 0x562f40097b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90d77fe640 1 -- 172.21.15.100:0/4219201975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 msgr2=0x562f400970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90d77fe640 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90d77fe640 1 -- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 msgr2=0x562f40097b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90d77fe640 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 0x562f40097b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90d77fe640 1 -- 172.21.15.100:0/4219201975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3fd03580 con 0x562f4008f980 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90d77fe640 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40097610 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0bcc30 tx=0x7f90cc0c4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bbfd648504752e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90b77fe640 1 -- 172.21.15.100:0/4219201975 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0c0ed0 con 0x562f4008f980 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90b77fe640 1 -- 172.21.15.100:0/4219201975 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f90cc0ab0b0 con 0x562f4008f980 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.175+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90cc0c07d0 con 0x562f4008f980 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90b77fe640 1 -- 172.21.15.100:0/4219201975 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90cc0bce40 con 0x562f4008f980 2024-09-12T02:07:55.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 10 client.15546 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562f3fdcd960 con 0x562f4008f980 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90b77fe640 1 -- 172.21.15.100:0/4219201975 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90cc0c07d0 con 0x562f4008f980 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90b77fe640 1 -- 172.21.15.100:0/4219201975 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90cc0bfc20 con 0x562f4008f980 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 10 client.15546 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 10 client.15546 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 20 client.15546 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f400a98c0 0x562f400abce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 4 client.15546 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.176+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f40001b90 con 0x562f400a98c0 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.177+0000 7f90d7fff640 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f400a98c0 0x562f400abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.177+0000 7f90b77fe640 10 client.15546 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.177+0000 7f90d7fff640 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f400a98c0 0x562f400abce0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f33b6190b21af0e6 server_cookie=915b4f753e10791c in_seq=0 out_seq=0 2024-09-12T02:07:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90b77fe640 1 -- 172.21.15.100:0/4219201975 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f40001b90 con 0x562f400a98c0 2024-09-12T02:07:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90b77fe640 10 client.15546 handle_command_reply: tid=0 2024-09-12T02:07:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 client.15546 shutdown 2024-09-12T02:07:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 msgr2=0x562f40097610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40097610 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0bcc30 tx=0x7f90cc0c4c00 comp rx=0 tx=0).stop 2024-09-12T02:07:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 shutdown_connections 2024-09-12T02:07:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f400a98c0 0x562f400abce0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 0x562f40097b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f980 0x562f40097610 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 --2- 172.21.15.100:0/4219201975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 >> 172.21.15.100:0/4219201975 conn(0x562f4008b5f0 msgr2=0x562f40091320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.178+0000 7f90b77fe640 0 client.15546 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.179+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 shutdown_connections 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.179+0000 7f90e074e740 1 -- 172.21.15.100:0/4219201975 wait complete. 2024-09-12T02:07:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.179+0000 7f90e074e740 20 client.15546 trim_cache size 0 max 16384 2024-09-12T02:07:55.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 Processor -- start 2024-09-12T02:07:55.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 -- start start 2024-09-12T02:07:55.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f060 0x562f40099040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f980 0x562f400b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 0x562f400b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90c4010cc0 con 0x562f4008f060 2024-09-12T02:07:55.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90c400e590 con 0x562f4009a240 2024-09-12T02:07:55.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90e074e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90c400c3e0 con 0x562f4008f980 2024-09-12T02:07:55.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f060 0x562f40099040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f060 0x562f40099040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59842/0 (socket says 172.21.15.100:59842) 2024-09-12T02:07:55.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90d7fff640 1 -- 172.21.15.100:0/2988686698 learned_addr learned my addr 172.21.15.100:0/2988686698 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:55.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.196+0000 7f90d77fe640 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f980 0x562f400b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90d7fff640 1 -- 172.21.15.100:0/2988686698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f980 msgr2=0x562f400b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90d7fff640 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f980 0x562f400b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90d7fff640 1 -- 172.21.15.100:0/2988686698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 msgr2=0x562f400b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90d7fff640 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 0x562f400b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90d7fff640 1 -- 172.21.15.100:0/2988686698 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f40091ed0 con 0x562f4008f060 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90d7fff640 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f060 0x562f40099040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f90c800bac0 tx=0x7f90c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa63999f589464a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90bdffb640 1 -- 172.21.15.100:0/2988686698 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8004020 con 0x562f4008f060 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90bdffb640 1 -- 172.21.15.100:0/2988686698 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90c80041c0 con 0x562f4008f060 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.197+0000 7f90bdffb640 1 -- 172.21.15.100:0/2988686698 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8021800 con 0x562f4008f060 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 -- 172.21.15.100:0/2988686698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f060 msgr2=0x562f40099040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f060 0x562f40099040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f90c800bac0 tx=0x7f90c8012000 comp rx=0 tx=0).stop 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 -- 172.21.15.100:0/2988686698 shutdown_connections 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4009a240 0x562f400b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f980 0x562f400b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 --2- 172.21.15.100:0/2988686698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4008f060 0x562f40099040 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 -- 172.21.15.100:0/2988686698 >> 172.21.15.100:0/2988686698 conn(0x562f4008b5f0 msgr2=0x562f40098930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 -- 172.21.15.100:0/2988686698 shutdown_connections 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.198+0000 7f90e074e740 1 -- 172.21.15.100:0/2988686698 wait complete. 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.199+0000 7f90e074e740 1 -- start start 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.199+0000 7f90e074e740 1 Processor -- start 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.199+0000 7f90e074e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.199+0000 7f90e074e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f980 0x562f4009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.199+0000 7f90e074e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4009a240 0x562f4009dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f980 0x562f4009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90e074e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90c400ca50 con 0x562f4009a240 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90e074e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90c400dec0 con 0x562f4008f980 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90dc912640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4009a240 0x562f4009dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f980 0x562f4009d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:55780/0 (socket says 172.21.15.100:55780) 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 -- 172.21.15.100:0/4264164610 learned_addr learned my addr 172.21.15.100:0/4264164610 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d7fff640 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90c400d120 con 0x562f4008f060 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90e074e740 10 client.0 _ll_register_callbacks cb 0x7f90cc0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 -- 172.21.15.100:0/4264164610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 msgr2=0x562f400a24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400a24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 -- 172.21.15.100:0/4264164610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4009a240 msgr2=0x562f4009dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4009a240 0x562f4009dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 -- 172.21.15.100:0/4264164610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4009e320 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90d77fe640 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f980 0x562f4009d820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0c04d0 tx=0x7f90cc0ab260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f1edf35cb268fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90b77fe640 1 -- 172.21.15.100:0/4264164610 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0c0130 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.200+0000 7f90b77fe640 1 -- 172.21.15.100:0/4264164610 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f90cc0c8fb0 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90c80041c0 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90b77fe640 1 -- 172.21.15.100:0/4264164610 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90cc0c1d60 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 10 client.25073 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562f4009e320 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90b77fe640 1 -- 172.21.15.100:0/4264164610 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90c80041c0 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90b77fe640 1 -- 172.21.15.100:0/4264164610 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90cc04e030 con 0x562f4008f980 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 10 client.25073 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 10 client.25073 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T02:07:55.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 20 client.25073 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f40114740 0x562f40116b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 4 client.25073 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bf6ca43f", "release": true, "await": true}] 2024-09-12T02:07:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bf6ca43f", "release": true, "await": true}) -- 0x562f3fffc0a0 con 0x562f40114740 2024-09-12T02:07:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.201+0000 7f90d7fff640 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f40114740 0x562f40116b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.202+0000 7f90b77fe640 10 client.25073 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:55.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.202+0000 7f90d7fff640 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f40114740 0x562f40116b60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8af1f338796891e6 server_cookie=6d1fb9fe475a7599 in_seq=0 out_seq=0 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.203+0000 7f90b77fe640 1 -- 172.21.15.100:0/4264164610 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562f3fffc0a0 con 0x562f40114740 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.203+0000 7f90b77fe640 10 client.25073 handle_command_reply: tid=0 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.203+0000 7f90e074e740 1 client.25073 shutdown 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.203+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f980 msgr2=0x562f4009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.203+0000 7f90e074e740 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f980 0x562f4009d820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0c04d0 tx=0x7f90cc0ab260 comp rx=0 tx=0).stop 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 shutdown_connections 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x562f40114740 0x562f40116b60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f4009a240 0x562f4009dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562f4008f980 0x562f4009d820 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 --2- 172.21.15.100:0/4264164610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f4008f060 0x562f400a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 >> 172.21.15.100:0/4264164610 conn(0x562f4008b5f0 msgr2=0x562f4008a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90b77fe640 0 client.25073 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 shutdown_connections 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 1 -- 172.21.15.100:0/4264164610 wait complete. 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.204+0000 7f90e074e740 20 client.25073 trim_cache size 0 max 16384 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 24, 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24452, 2024-09-12T02:07:55.209 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 4, 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": { 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "bf6ca43f": { 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 4, 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "age_ref": 0.0, 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "timeout": 90.0, 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "expiration": 144.5, 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "members": { 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "file:/": { 2024-09-12T02:07:55.210 INFO:teuthology.orchestra.run.smithi100.stdout: "excluded": false, 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: "state": { 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RELEASED", 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.0 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:07:55.211 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f90c00a2c00 msgr2=0x7f90c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f90c00a2c00 0x7f90c00a50c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f90c80058c0 tx=0x7f90c8005850 comp rx=0 tx=0).stop 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 msgr2=0x7f90d8198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d8198980 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f90cc006010 tx=0x7f90cc004270 comp rx=0 tx=0).stop 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 shutdown_connections 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f90c00a2c00 0x7f90c00a50c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90d810c160 0x7f90d819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90d8103650 0x7f90d8198980 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 --2- 172.21.15.100:0/3678000157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90d8102d30 0x7f90d8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.205+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 >> 172.21.15.100:0/3678000157 conn(0x7f90d80fc790 msgr2=0x7f90d80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.206+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 shutdown_connections 2024-09-12T02:07:55.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:07:55.206+0000 7f90de375640 1 -- 172.21.15.100:0/3678000157 wait complete. 2024-09-12T02:07:55.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:55 smithi100 ceph-mon[31179]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:07:55.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:55 smithi189 ceph-mon[35188]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:07:55.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:55 smithi117 ceph-mon[35240]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-12T02:07:55.948 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bf6ca43f', total seconds elapsed: 27.7 2024-09-12T02:07:57.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:57 smithi100 ceph-mon[31179]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-12T02:07:57.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:57 smithi189 ceph-mon[35188]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-12T02:07:57.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:57 smithi117 ceph-mon[35240]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-12T02:07:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 -- 172.21.15.100:0/999690559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338101c30 msgr2=0x7f73381020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 --2- 172.21.15.100:0/999690559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338101c30 0x7f73381020b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f732c009900 tx=0x7f732c02a410 comp rx=0 tx=0).stop 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 -- 172.21.15.100:0/999690559 shutdown_connections 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 --2- 172.21.15.100:0/999690559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73381025f0 0x7f7338108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 --2- 172.21.15.100:0/999690559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338101c30 0x7f73381020b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 --2- 172.21.15.100:0/999690559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7338100a40 0x7f7338100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 -- 172.21.15.100:0/999690559 >> 172.21.15.100:0/999690559 conn(0x7f73380fc1e0 msgr2=0x7f73380fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 -- 172.21.15.100:0/999690559 shutdown_connections 2024-09-12T02:07:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.228+0000 7f733e80e640 1 -- 172.21.15.100:0/999690559 wait complete. 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.229+0000 7f733e80e640 1 Processor -- start 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.229+0000 7f733e80e640 1 -- start start 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733e80e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338100a40 0x7f733806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733e80e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7338101c30 0x7f733819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338100a40 0x7f733806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338100a40 0x7f733806a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59874/0 (socket says 172.21.15.100:59874) 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 -- 172.21.15.100:0/3568499154 learned_addr learned my addr 172.21.15.100:0/3568499154 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733e80e640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73381025f0 0x7f73381a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f733810c6a0 con 0x7f7338100a40 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f733810c520 con 0x7f73381025f0 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f733810c820 con 0x7f7338101c30 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f73377fe640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7338101c30 0x7f733819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 -- 172.21.15.100:0/3568499154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7338101c30 msgr2=0x7f733819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733cdab640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73381025f0 0x7f73381a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7338101c30 0x7f733819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 -- 172.21.15.100:0/3568499154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73381025f0 msgr2=0x7f73381a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73381025f0 0x7f73381a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 -- 172.21.15.100:0/3568499154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73381a1bd0 con 0x7f7338100a40 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f733cdab640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73381025f0 0x7f73381a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.230+0000 7f7337fff640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338100a40 0x7f733806a410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f732800c970 tx=0x7f732800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.231+0000 7f73357fa640 1 -- 172.21.15.100:0/3568499154 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328007c10 con 0x7f7338100a40 2024-09-12T02:07:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.231+0000 7f73357fa640 1 -- 172.21.15.100:0/3568499154 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7328007db0 con 0x7f7338100a40 2024-09-12T02:07:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.231+0000 7f73357fa640 1 -- 172.21.15.100:0/3568499154 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732800f940 con 0x7f7338100a40 2024-09-12T02:07:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.232+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73381a1e60 con 0x7f7338100a40 2024-09-12T02:07:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.232+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73381a2270 con 0x7f7338100a40 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 Processor -- start 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 -- start start 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f73357fa640 1 -- 172.21.15.100:0/3568499154 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f732800fae0 con 0x7f7338100a40 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33a9a0 0x564f5a33ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a33fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a340370 0x564f5a342830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f5a29e2f0 con 0x564f5a33b2e0 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564f5a246270 con 0x564f5a33a9a0 2024-09-12T02:07:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f7341686740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564f5a29a2b0 con 0x564f5a340370 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f73377fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a340370 0x564f5a342830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f733cdab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33a9a0 0x564f5a33ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f73377fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a340370 0x564f5a342830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:39832/0 (socket says 172.21.15.100:39832) 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.235+0000 7f73377fe640 1 -- 172.21.15.100:0/4061538356 learned_addr learned my addr 172.21.15.100:0/4061538356 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f7337fff640 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a33fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f73357fa640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73200a2d60 0x7f73200a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f733cdab640 1 -- 172.21.15.100:0/4061538356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a340370 msgr2=0x564f5a342830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f733cdab640 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a340370 0x564f5a342830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f733cdab640 1 -- 172.21.15.100:0/4061538356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 msgr2=0x564f5a33fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f733cdab640 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a33fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f733cdab640 1 -- 172.21.15.100:0/4061538356 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f5a245340 con 0x564f5a33a9a0 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f7337fff640 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a33fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f73357fa640 1 -- 172.21.15.100:0/3568499154 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f73280cf460 con 0x7f7338100a40 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f733cdab640 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33a9a0 0x564f5a33ada0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7330009ec0 tx=0x7f733000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ffcab8ecaf03b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.236+0000 7f733cdab640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73200a2d60 0x7f73200a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.237+0000 7f731e7fc640 1 -- 172.21.15.100:0/4061538356 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330011640 con 0x564f5a33a9a0 2024-09-12T02:07:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.237+0000 7f731e7fc640 1 -- 172.21.15.100:0/4061538356 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f733001ddc0 con 0x564f5a33a9a0 2024-09-12T02:07:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.237+0000 7f731e7fc640 1 -- 172.21.15.100:0/4061538356 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330010d90 con 0x564f5a33a9a0 2024-09-12T02:07:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 -- 172.21.15.100:0/4061538356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33a9a0 msgr2=0x564f5a33ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f733cdab640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73200a2d60 0x7f73200a5220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f733001e000 tx=0x7f7330021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33a9a0 0x564f5a33ada0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7330009ec0 tx=0x7f733000f730 comp rx=0 tx=0).stop 2024-09-12T02:07:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 -- 172.21.15.100:0/4061538356 shutdown_connections 2024-09-12T02:07:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a340370 0x564f5a342830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a33fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 --2- 172.21.15.100:0/4061538356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33a9a0 0x564f5a33ada0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 -- 172.21.15.100:0/4061538356 >> 172.21.15.100:0/4061538356 conn(0x564f5a336010 msgr2=0x564f5a336410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 -- 172.21.15.100:0/4061538356 shutdown_connections 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 -- 172.21.15.100:0/4061538356 wait complete. 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.238+0000 7f7341686740 1 -- start start 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7341686740 1 Processor -- start 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7341686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a344bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7341686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a345100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f73377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a345100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f73377fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a345100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59898/0 (socket says 172.21.15.100:59898) 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f73377fe640 1 -- 172.21.15.100:0/1677629309 learned_addr learned my addr 172.21.15.100:0/1677629309 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7341686740 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a34c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f5a343340 con 0x564f5a33b2e0 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564f5a227290 con 0x564f5a340370 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564f5a3434c0 con 0x564f5a33a9a0 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f7337fff640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a344bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.239+0000 7f733cdab640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a34c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7341686740 10 client.0 _ll_register_callbacks cb 0x564f5a258140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7337fff640 1 -- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 msgr2=0x564f5a34c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7337fff640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a34c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7337fff640 1 -- 172.21.15.100:0/1677629309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 msgr2=0x564f5a345100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7337fff640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a345100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7337fff640 1 -- 172.21.15.100:0/1677629309 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f59fb1210 con 0x564f5a33a9a0 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f73377fe640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a345100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f733001ddc0 con 0x564f5a33a9a0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7337fff640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a344bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73280986d0 tx=0x7f732809b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14d5500b2d9f5cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f73177fe640 10 client.25015 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f73177fe640 1 -- 172.21.15.100:0/1677629309 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73280a48e0 con 0x564f5a33a9a0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f73177fe640 1 -- 172.21.15.100:0/1677629309 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f732809a000 con 0x564f5a33a9a0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f73177fe640 1 -- 172.21.15.100:0/1677629309 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7328018b80 con 0x564f5a33a9a0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7341686740 10 client.25015 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.240+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=24}) -- 0x564f5a07d620 con 0x564f5a33a9a0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f73177fe640 1 -- 172.21.15.100:0/1677629309 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f73280a4450 con 0x564f5a33a9a0 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f7341686740 10 client.25015 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f7341686740 10 client.25015 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f7341686740 20 client.25015 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f7341686740 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a352a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f7341686740 4 client.25015 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:07:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f5a2aba20 con 0x564f5a3505f0 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.241+0000 7f73377fe640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a352a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.242+0000 7f73177fe640 10 client.25015 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.242+0000 7f73377fe640 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a352a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2ffc0f91daff7c6 server_cookie=1615f1281cbf85de in_seq=0 out_seq=0 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.242+0000 7f73177fe640 1 -- 172.21.15.100:0/1677629309 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f5a2aba20 con 0x564f5a3505f0 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.242+0000 7f73177fe640 10 client.25015 handle_command_reply: tid=0 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.242+0000 7f7341686740 1 client.25015 shutdown 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.242+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 msgr2=0x564f5a344bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a344bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73280986d0 tx=0x7f732809b720 comp rx=0 tx=0).stop 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 shutdown_connections 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a352a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a34c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f73177fe640 0 client.25015 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33b2e0 0x564f5a345100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 --2- 172.21.15.100:0/1677629309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a344bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 >> 172.21.15.100:0/1677629309 conn(0x564f5a336010 msgr2=0x564f5a337820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 shutdown_connections 2024-09-12T02:07:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 1 -- 172.21.15.100:0/1677629309 wait complete. 2024-09-12T02:07:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.243+0000 7f7341686740 20 client.25015 trim_cache size 0 max 16384 2024-09-12T02:07:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.270+0000 7f7341686740 1 Processor -- start 2024-09-12T02:07:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.270+0000 7f7341686740 1 -- start start 2024-09-12T02:07:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7341686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33a9a0 0x564f5a34cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7341686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33b2e0 0x564f5a34c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7341686740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a3350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7341686740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73381ad970 con 0x564f5a33a9a0 2024-09-12T02:07:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7341686740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73381ab240 con 0x564f5a340370 2024-09-12T02:07:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7341686740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73381a9090 con 0x564f5a33b2e0 2024-09-12T02:07:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33a9a0 0x564f5a34cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33a9a0 0x564f5a34cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59902/0 (socket says 172.21.15.100:59902) 2024-09-12T02:07:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 -- 172.21.15.100:0/561650089 learned_addr learned my addr 172.21.15.100:0/561650089 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f733cdab640 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a3350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 -- 172.21.15.100:0/561650089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33b2e0 msgr2=0x564f5a34c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33b2e0 0x564f5a34c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 -- 172.21.15.100:0/561650089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 msgr2=0x564f5a3350b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a3350b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 -- 172.21.15.100:0/561650089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f5a335e30 con 0x564f5a33a9a0 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f733cdab640 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a3350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.271+0000 7f7337fff640 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33a9a0 0x564f5a34cbb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f732809bc90 tx=0x7f73280ce000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a88879789010fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.272+0000 7f731dffb640 1 -- 172.21.15.100:0/561650089 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73280a48e0 con 0x564f5a33a9a0 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.272+0000 7f731dffb640 1 -- 172.21.15.100:0/561650089 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73280c0020 con 0x564f5a33a9a0 2024-09-12T02:07:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.272+0000 7f731dffb640 1 -- 172.21.15.100:0/561650089 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732809b320 con 0x564f5a33a9a0 2024-09-12T02:07:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 -- 172.21.15.100:0/561650089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33a9a0 msgr2=0x564f5a34cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33a9a0 0x564f5a34cbb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f732809bc90 tx=0x7f73280ce000 comp rx=0 tx=0).stop 2024-09-12T02:07:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 -- 172.21.15.100:0/561650089 shutdown_connections 2024-09-12T02:07:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a340370 0x564f5a3350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33b2e0 0x564f5a34c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 --2- 172.21.15.100:0/561650089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a33a9a0 0x564f5a34cbb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 -- 172.21.15.100:0/561650089 >> 172.21.15.100:0/561650089 conn(0x564f5a336010 msgr2=0x564f5a3349a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 -- 172.21.15.100:0/561650089 shutdown_connections 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.273+0000 7f7341686740 1 -- 172.21.15.100:0/561650089 wait complete. 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.274+0000 7f7341686740 1 -- start start 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.274+0000 7f7341686740 1 Processor -- start 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.274+0000 7f7341686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a349440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.274+0000 7f7341686740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33b2e0 0x564f5a349980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f7341686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a340370 0x564f5a34a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f7341686740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73381a9700 con 0x564f5a340370 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f7341686740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73381aab70 con 0x564f5a33b2e0 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33b2e0 0x564f5a349980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f733cdab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a340370 0x564f5a34a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33b2e0 0x564f5a349980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:55850/0 (socket says 172.21.15.100:55850) 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f733cdab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a340370 0x564f5a34a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59908/0 (socket says 172.21.15.100:59908) 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 -- 172.21.15.100:0/4136229933 learned_addr learned my addr 172.21.15.100:0/4136229933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f7337fff640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a349440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73381a9dd0 con 0x564f5a33a9a0 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f7341686740 10 client.0 _ll_register_callbacks cb 0x7f7328018e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 -- 172.21.15.100:0/4136229933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 msgr2=0x564f5a349440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a349440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 -- 172.21.15.100:0/4136229933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a340370 msgr2=0x564f5a34a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a340370 0x564f5a34a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f73377fe640 1 -- 172.21.15.100:0/4136229933 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f5a34afa0 con 0x564f5a33b2e0 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f733cdab640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a340370 0x564f5a34a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.275+0000 7f7337fff640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a349440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f73377fe640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33b2e0 0x564f5a349980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f732c005940 tx=0x7f732c032bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b15f813424bbb829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f73177fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f73177fe640 1 -- 172.21.15.100:0/4136229933 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c035040 con 0x564f5a33b2e0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f73177fe640 1 -- 172.21.15.100:0/4136229933 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f732c004450 con 0x564f5a33b2e0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73280c0020 con 0x564f5a33b2e0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f73177fe640 1 -- 172.21.15.100:0/4136229933 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f732c005040 con 0x564f5a33b2e0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f7341686740 10 client.25085 fetch_fsmap learned FSMap version 24 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.276+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564f5a34c250 con 0x564f5a33b2e0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f73177fe640 1 -- 172.21.15.100:0/4136229933 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73280c0020 con 0x564f5a33b2e0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f73177fe640 1 -- 172.21.15.100:0/4136229933 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f732c0035f0 con 0x564f5a33b2e0 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7341686740 10 client.25085 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:07:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7341686740 10 client.25085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:07:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7341686740 20 client.25085 populate_metadata read hostname 'smithi100' 2024-09-12T02:07:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7341686740 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a3bd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7341686740 4 client.25085 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:07:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f5a2a5d70 con 0x564f5a3505f0 2024-09-12T02:07:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7337fff640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a3bd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f73177fe640 10 client.25085 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.277+0000 7f7337fff640 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a3bd950 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af110d8dd4e055d0 server_cookie=9b44475fd2452c8f in_seq=0 out_seq=0 2024-09-12T02:07:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f73177fe640 1 -- 172.21.15.100:0/4136229933 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f5a2a5d70 con 0x564f5a3505f0 2024-09-12T02:07:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f73177fe640 10 client.25085 handle_command_reply: tid=0 2024-09-12T02:07:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 client.25085 shutdown 2024-09-12T02:07:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33b2e0 msgr2=0x564f5a349980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33b2e0 0x564f5a349980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f732c005940 tx=0x7f732c032bc0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 shutdown_connections 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x564f5a3505f0 0x564f5a3bd950 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f73177fe640 0 client.25085 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f5a340370 0x564f5a34a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564f5a33b2e0 0x564f5a349980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 --2- 172.21.15.100:0/4136229933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f5a33a9a0 0x564f5a349440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 >> 172.21.15.100:0/4136229933 conn(0x564f5a336010 msgr2=0x564f5a3351c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.283+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 shutdown_connections 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f7341686740 1 -- 172.21.15.100:0/4136229933 wait complete. 2024-09-12T02:07:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f7341686740 20 client.25085 trim_cache size 0 max 16384 2024-09-12T02:07:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-09-12T02:07:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-09-12T02:07:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-09-12T02:07:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-09-12T02:07:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73200a2d60 msgr2=0x7f73200a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73200a2d60 0x7f73200a5220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f733001e000 tx=0x7f7330021000 comp rx=0 tx=0).stop 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338100a40 msgr2=0x7f733806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338100a40 0x7f733806a410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f732800c970 tx=0x7f732800ce30 comp rx=0 tx=0).stop 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 shutdown_connections 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f73200a2d60 0x7f73200a5220 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73381025f0 0x7f73381a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7338101c30 0x7f733819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 --2- 172.21.15.100:0/3568499154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7338100a40 0x7f733806a410 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 >> 172.21.15.100:0/3568499154 conn(0x7f73380fc1e0 msgr2=0x7f7338104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 shutdown_connections 2024-09-12T02:07:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:07:59.284+0000 7f733e80e640 1 -- 172.21.15.100:0/3568499154 wait complete. 2024-09-12T02:07:59.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:07:59 smithi100 ceph-mon[31179]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:07:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:07:59 smithi189 ceph-mon[35188]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:07:59.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:07:59 smithi117 ceph-mon[35240]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:08:01.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:01 smithi117 ceph-mon[35240]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T02:08:01.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:01 smithi100 ceph-mon[31179]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T02:08:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:01 smithi189 ceph-mon[35188]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T02:08:03.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:03 smithi100 ceph-mon[31179]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:08:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:03 smithi189 ceph-mon[35188]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:08:03.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:03 smithi117 ceph-mon[35240]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:08:04.987 INFO:tasks.workunit.client.0.smithi100.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:08:04.988 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-12T02:08:04.988 INFO:tasks.workunit.client.0.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:08:04.988 INFO:tasks.workunit.client.0.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:08:04.988 INFO:tasks.workunit.client.0.smithi100.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:08:04.988 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr: git switch -c 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr:Or undo this operation with: 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr: git switch - 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-12T02:08:04.989 INFO:tasks.workunit.client.0.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:08:04.990 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-12T02:08:04.990 INFO:tasks.workunit.client.0.smithi100.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:08:04.993 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:08:05.059 INFO:tasks.workunit.client.0.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:08:05.062 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:08:05.062 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:08:05.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:05 smithi100 ceph-mon[31179]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:08:05.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:05 smithi189 ceph-mon[35188]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:08:05.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:05 smithi117 ceph-mon[35240]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T02:08:05.808 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:08:05.882 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:08:05.922 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:08:05.924 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:08:05.924 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:08:05.964 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:08:05.968 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:08:05.968 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:08:06.025 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-09-12T02:08:06.026 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-09-12T02:08:06.026 DEBUG:teuthology.orchestra.run.smithi100:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-09-12T02:08:06.088 INFO:tasks.workunit.client.0.smithi100.stdout:test large (16MB) dio write 2024-09-12T02:08:06.088 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test large (16MB) dio write' 2024-09-12T02:08:06.089 INFO:tasks.workunit.client.0.smithi100.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-09-12T02:08:06.180 INFO:tasks.workunit.client.0.smithi100.stderr:1+0 records in 2024-09-12T02:08:06.181 INFO:tasks.workunit.client.0.smithi100.stderr:1+0 records out 2024-09-12T02:08:06.181 INFO:tasks.workunit.client.0.smithi100.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.089988 s, 186 MB/s 2024-09-12T02:08:06.181 INFO:tasks.workunit.client.0.smithi100.stdout:OK 2024-09-12T02:08:06.182 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo OK 2024-09-12T02:08:06.182 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:08:06.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:08:06.258 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-09-12T02:08:06.258 DEBUG:teuthology.orchestra.run.smithi100:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-09-12T02:08:07.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:07 smithi100 ceph-mon[31179]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T02:08:07.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:07 smithi189 ceph-mon[35188]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T02:08:07.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:07 smithi117 ceph-mon[35240]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T02:08:09.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:09 smithi100 ceph-mon[31179]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-12T02:08:09.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:09 smithi189 ceph-mon[35188]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-12T02:08:09.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:09 smithi117 ceph-mon[35240]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-12T02:08:11.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:11 smithi100 ceph-mon[31179]: pgmap v366: 97 pgs: 97 active+clean; 688 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-12T02:08:11.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:11 smithi189 ceph-mon[35188]: pgmap v366: 97 pgs: 97 active+clean; 688 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-12T02:08:11.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:11 smithi117 ceph-mon[35240]: pgmap v366: 97 pgs: 97 active+clean; 688 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-12T02:08:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 -- 172.21.15.100:0/1119260778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78102d50 msgr2=0x7fdc781031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/1119260778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78102d50 0x7fdc781031d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009900 tx=0x7fdc6c02a410 comp rx=0 tx=0).stop 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 -- 172.21.15.100:0/1119260778 shutdown_connections 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/1119260778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc78103710 0x7fdc78109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/1119260778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78102d50 0x7fdc781031d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/1119260778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc78101b60 0x7fdc78101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 -- 172.21.15.100:0/1119260778 >> 172.21.15.100:0/1119260778 conn(0x7fdc780fd2e0 msgr2=0x7fdc780ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 -- 172.21.15.100:0/1119260778 shutdown_connections 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.376+0000 7fdc7cd33640 1 -- 172.21.15.100:0/1119260778 wait complete. 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 Processor -- start 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 -- start start 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc78101b60 0x7fdc7819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc78102d50 0x7fdc7819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78103710 0x7fdc781a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7810d860 con 0x7fdc78103710 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7810d6e0 con 0x7fdc78102d50 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc7cd33640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7810d9e0 con 0x7fdc78101b60 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc76d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78103710 0x7fdc781a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.377+0000 7fdc76d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78103710 0x7fdc781a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33788/0 (socket says 172.21.15.100:33788) 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc76d9d640 1 -- 172.21.15.100:0/531119150 learned_addr learned my addr 172.21.15.100:0/531119150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc7659c640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc78101b60 0x7fdc7819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc78102d50 0x7fdc7819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc76d9d640 1 -- 172.21.15.100:0/531119150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc78101b60 msgr2=0x7fdc7819a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc76d9d640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc78101b60 0x7fdc7819a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc76d9d640 1 -- 172.21.15.100:0/531119150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc78102d50 msgr2=0x7fdc7819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc76d9d640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc78102d50 0x7fdc7819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc76d9d640 1 -- 172.21.15.100:0/531119150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc781a1c60 con 0x7fdc78103710 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc76d9d640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78103710 0x7fdc781a15f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000cce0 tx=0x7fdc7000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc677fe640 1 -- 172.21.15.100:0/531119150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000f450 con 0x7fdc78103710 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc781a1f50 con 0x7fdc78103710 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc677fe640 1 -- 172.21.15.100:0/531119150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc7000fad0 con 0x7fdc78103710 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc677fe640 1 -- 172.21.15.100:0/531119150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70018b60 con 0x7fdc78103710 2024-09-12T02:08:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.378+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc781a2490 con 0x7fdc78103710 2024-09-12T02:08:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc677fe640 1 -- 172.21.15.100:0/531119150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fdc70018d00 con 0x7fdc78103710 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 Processor -- start 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 -- start start 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f531503da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f531508da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 0x55f53150b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f5314672f0 con 0x55f5315042e0 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f53140f270 con 0x55f5315039a0 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.381+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f5314632b0 con 0x55f531509370 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f531508da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc75d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f531503da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f531508da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33804/0 (socket says 172.21.15.100:33804) 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 -- 172.21.15.100:0/1847111215 learned_addr learned my addr 172.21.15.100:0/1847111215 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc677fe640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdc600a2c30 0x7fdc600a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 0x55f53150b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 -- 172.21.15.100:0/1847111215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 msgr2=0x55f53150b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 0x55f53150b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 -- 172.21.15.100:0/1847111215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 msgr2=0x55f531503da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f531503da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 -- 172.21.15.100:0/1847111215 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53140e340 con 0x55f5315042e0 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc677fe640 1 -- 172.21.15.100:0/531119150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdc700cf5d0 con 0x7fdc78103710 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc76d9d640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdc600a2c30 0x7fdc600a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc7659c640 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f531508da0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009a40 tx=0x7fdc68009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28566835e04e6e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.382+0000 7fdc64ff9640 1 -- 172.21.15.100:0/1847111215 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68024070 con 0x55f5315042e0 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc64ff9640 1 -- 172.21.15.100:0/1847111215 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc68017d20 con 0x55f5315042e0 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc64ff9640 1 -- 172.21.15.100:0/1847111215 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6801fb60 con 0x55f5315042e0 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 -- 172.21.15.100:0/1847111215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 msgr2=0x55f531508da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f531508da0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009a40 tx=0x7fdc68009f00 comp rx=0 tx=0).stop 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc76d9d640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdc600a2c30 0x7fdc600a50f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc700982a0 tx=0x7fdc70018400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 -- 172.21.15.100:0/1847111215 shutdown_connections 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 0x55f53150b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f531508da0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/1847111215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f531503da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 -- 172.21.15.100:0/1847111215 >> 172.21.15.100:0/1847111215 conn(0x55f5314ff010 msgr2=0x55f5314ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 -- 172.21.15.100:0/1847111215 shutdown_connections 2024-09-12T02:08:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.383+0000 7fdc7fac9740 1 -- 172.21.15.100:0/1847111215 wait complete. 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 -- start start 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 Processor -- start 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315039a0 0x55f53150dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 0x55f53150e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f531509370 0x55f531515130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f53150c390 con 0x55f5315039a0 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f5313f0290 con 0x55f531509370 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f53150c510 con 0x55f5315042e0 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc7fac9740 10 client.0 _ll_register_callbacks cb 0x55f531421140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315039a0 0x55f53150dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315039a0 0x55f53150dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33820/0 (socket says 172.21.15.100:33820) 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 -- 172.21.15.100:0/491609790 learned_addr learned my addr 172.21.15.100:0/491609790 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f531509370 0x55f531515130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 -- 172.21.15.100:0/491609790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 msgr2=0x55f53150e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 0x55f53150e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 -- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f531509370 msgr2=0x55f531515130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f531509370 0x55f531515130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.384+0000 7fdc75d9b640 1 -- 172.21.15.100:0/491609790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f53117a210 con 0x55f5315039a0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315039a0 0x55f53150dbb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c032fd0 tx=0x7fdc6c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4da888bfb0ed95a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc5dffb640 1 -- 172.21.15.100:0/491609790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c035040 con 0x55f5315039a0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc5dffb640 1 -- 172.21.15.100:0/491609790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdc6c005020 con 0x55f5315039a0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc68017d20 con 0x55f5315039a0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc5dffb640 1 -- 172.21.15.100:0/491609790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc6c005220 con 0x55f5315039a0 2024-09-12T02:08:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc7fac9740 10 client.15579 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f531246620 con 0x55f5315039a0 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.385+0000 7fdc5dffb640 1 -- 172.21.15.100:0/491609790 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc68017d20 con 0x55f5315039a0 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc5dffb640 1 -- 172.21.15.100:0/491609790 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdc6c03a040 con 0x55f5315039a0 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7fac9740 10 client.15579 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7fac9740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7fac9740 20 client.15579 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531519820 0x55f53151bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7fac9740 4 client.15579 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f531474a20 con 0x55f531519820 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7659c640 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531519820 0x55f53151bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc7659c640 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531519820 0x55f53151bc50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd0efac450a9d96b server_cookie=8a49e027c7115b4f in_seq=0 out_seq=0 2024-09-12T02:08:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.386+0000 7fdc5dffb640 10 client.15579 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc5dffb640 1 -- 172.21.15.100:0/491609790 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f531474a20 con 0x55f531519820 2024-09-12T02:08:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc5dffb640 10 client.15579 handle_command_reply: tid=0 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 client.15579 shutdown 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315039a0 msgr2=0x55f53150dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315039a0 0x55f53150dbb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c032fd0 tx=0x7fdc6c02a410 comp rx=0 tx=0).stop 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 shutdown_connections 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531519820 0x55f53151bc50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f531509370 0x55f531515130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 0x55f53150e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc5dffb640 0 client.15579 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/491609790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315039a0 0x55f53150dbb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 >> 172.21.15.100:0/491609790 conn(0x55f5314ff010 msgr2=0x55f531500820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 shutdown_connections 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.387+0000 7fdc7fac9740 1 -- 172.21.15.100:0/491609790 wait complete. 2024-09-12T02:08:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.388+0000 7fdc7fac9740 20 client.15579 trim_cache size 0 max 16384 2024-09-12T02:08:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 Processor -- start 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 -- start start 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f53150dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f5315150f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 0x55f531520550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc781a96e0 con 0x55f5315042e0 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdc781a6fb0 con 0x55f5315039a0 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc781a4e00 con 0x55f531509370 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f5315150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f5315150f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33834/0 (socket says 172.21.15.100:33834) 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 -- 172.21.15.100:0/2697179289 learned_addr learned my addr 172.21.15.100:0/2697179289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f53150dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 -- 172.21.15.100:0/2697179289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 msgr2=0x55f531520550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 0x55f531520550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 -- 172.21.15.100:0/2697179289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 msgr2=0x55f53150dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f53150dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 -- 172.21.15.100:0/2697179289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5315086f0 con 0x55f5315042e0 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.402+0000 7fdc7659c640 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f5315150f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009960 tx=0x7fdc6801f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5b1053b5b031a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc5ffff640 1 -- 172.21.15.100:0/2697179289 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68024040 con 0x55f5315042e0 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc5ffff640 1 -- 172.21.15.100:0/2697179289 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc68026040 con 0x55f5315042e0 2024-09-12T02:08:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc5ffff640 1 -- 172.21.15.100:0/2697179289 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6802b440 con 0x55f5315042e0 2024-09-12T02:08:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 -- 172.21.15.100:0/2697179289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 msgr2=0x55f5315150f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f5315150f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009960 tx=0x7fdc6801f440 comp rx=0 tx=0).stop 2024-09-12T02:08:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 -- 172.21.15.100:0/2697179289 shutdown_connections 2024-09-12T02:08:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f531509370 0x55f531520550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f5315042e0 0x55f5315150f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/2697179289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f53150dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 -- 172.21.15.100:0/2697179289 >> 172.21.15.100:0/2697179289 conn(0x55f5314ff010 msgr2=0x55f5314fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 -- 172.21.15.100:0/2697179289 shutdown_connections 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.403+0000 7fdc7fac9740 1 -- 172.21.15.100:0/2697179289 wait complete. 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 -- start start 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 Processor -- start 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f5315130c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 0x55f531513600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f531509370 0x55f531514610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc781a5470 con 0x55f531509370 2024-09-12T02:08:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdc781a68e0 con 0x55f5315039a0 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc781a5b40 con 0x55f5315042e0 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7fac9740 10 client.0 _ll_register_callbacks cb 0x7fdc6c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f531509370 0x55f531514610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f531509370 0x55f531514610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33850/0 (socket says 172.21.15.100:33850) 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 -- 172.21.15.100:0/368089425 learned_addr learned my addr 172.21.15.100:0/368089425 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f5315130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc7659c640 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 0x55f531513600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 -- 172.21.15.100:0/368089425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 msgr2=0x55f531513600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 0x55f531513600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 -- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 msgr2=0x55f5315130c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f5315130c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 -- 172.21.15.100:0/368089425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f531514c20 con 0x55f531509370 2024-09-12T02:08:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc75d9b640 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f531509370 0x55f531514610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c006010 tx=0x7fdc6c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28ba7ed13509c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.404+0000 7fdc5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc5dffb640 1 -- 172.21.15.100:0/368089425 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c035070 con 0x55f531509370 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc68026040 con 0x55f531509370 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc5dffb640 1 -- 172.21.15.100:0/368089425 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdc6c031bd0 con 0x55f531509370 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc5dffb640 1 -- 172.21.15.100:0/368089425 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc6c031dd0 con 0x55f531509370 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 10 client.15585 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f531584f10 con 0x55f531509370 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc5dffb640 1 -- 172.21.15.100:0/368089425 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc68026040 con 0x55f531509370 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc5dffb640 1 -- 172.21.15.100:0/368089425 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdc6c004e40 con 0x55f531509370 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 10 client.15585 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 20 client.15585 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531585870 0x55f531587c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 4 client.15585 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:08:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.405+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f53146ed70 con 0x55f531585870 2024-09-12T02:08:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.406+0000 7fdc7659c640 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531585870 0x55f531587c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.406+0000 7fdc7659c640 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531585870 0x55f531587c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22b532b6c154b327 server_cookie=6276c0ed3b0eb8c0 in_seq=0 out_seq=0 2024-09-12T02:08:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.406+0000 7fdc5dffb640 10 client.15585 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc5dffb640 1 -- 172.21.15.100:0/368089425 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f53146ed70 con 0x55f531585870 2024-09-12T02:08:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc5dffb640 10 client.15585 handle_command_reply: tid=0 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 client.15585 shutdown 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f531509370 msgr2=0x55f531514610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f531509370 0x55f531514610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c006010 tx=0x7fdc6c001e50 comp rx=0 tx=0).stop 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 shutdown_connections 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55f531585870 0x55f531587c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f531509370 0x55f531514610 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5315042e0 0x55f531513600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 --2- 172.21.15.100:0/368089425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5315039a0 0x55f5315130c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc5dffb640 0 client.15585 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 >> 172.21.15.100:0/368089425 conn(0x55f5314ff010 msgr2=0x55f5314ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 shutdown_connections 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 1 -- 172.21.15.100:0/368089425 wait complete. 2024-09-12T02:08:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.417+0000 7fdc7fac9740 20 client.15585 trim_cache size 0 max 16384 2024-09-12T02:08:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-09-12T02:08:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-09-12T02:08:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-09-12T02:08:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdc600a2c30 msgr2=0x7fdc600a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdc600a2c30 0x7fdc600a50f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc700982a0 tx=0x7fdc70018400 comp rx=0 tx=0).stop 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78103710 msgr2=0x7fdc781a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78103710 0x7fdc781a15f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000cce0 tx=0x7fdc7000a620 comp rx=0 tx=0).stop 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 shutdown_connections 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fdc600a2c30 0x7fdc600a50f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc78103710 0x7fdc781a15f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc78102d50 0x7fdc7819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 --2- 172.21.15.100:0/531119150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc78101b60 0x7fdc7819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 >> 172.21.15.100:0/531119150 conn(0x7fdc780fd2e0 msgr2=0x7fdc78074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 shutdown_connections 2024-09-12T02:08:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:12.418+0000 7fdc7cd33640 1 -- 172.21.15.100:0/531119150 wait complete. 2024-09-12T02:08:13.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:13 smithi100 ceph-mon[31179]: pgmap v367: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.67k op/s 2024-09-12T02:08:13.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:13 smithi189 ceph-mon[35188]: pgmap v367: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.67k op/s 2024-09-12T02:08:13.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:13 smithi117 ceph-mon[35240]: pgmap v367: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.67k op/s 2024-09-12T02:08:14.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:14 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:14.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:14 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:14.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:14 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:15.552 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:08:15.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:15 smithi100 ceph-mon[31179]: pgmap v368: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.67k op/s 2024-09-12T02:08:15.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:15.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:15.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:15 smithi189 ceph-mon[35188]: pgmap v368: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.67k op/s 2024-09-12T02:08:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:15 smithi117 ceph-mon[35240]: pgmap v368: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.67k op/s 2024-09-12T02:08:15.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:15.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:15.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:08:15.821 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 -- 172.21.15.100:0/4163547201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 msgr2=0x7f4e2410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4163547201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2410ec50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009cd0 tx=0x7f4e1c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 -- 172.21.15.100:0/4163547201 shutdown_connections 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4163547201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2410ec50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4163547201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e24103760 0x7f4e24107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4163547201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102db0 0x7f4e24103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 -- 172.21.15.100:0/4163547201 >> 172.21.15.100:0/4163547201 conn(0x7f4e240fc7d0 msgr2=0x7f4e240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 -- 172.21.15.100:0/4163547201 shutdown_connections 2024-09-12T02:08:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.322+0000 7f4e2992a640 1 -- 172.21.15.100:0/4163547201 wait complete. 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.323+0000 7f4e2992a640 1 Processor -- start 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e2992a640 1 -- start start 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e2992a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102db0 0x7f4e241985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e2992a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e24103760 0x7f4e24198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e2992a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e2992a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24112130 con 0x7f4e241082e0 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e2992a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24111fb0 con 0x7f4e24102db0 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e2992a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241122b0 con 0x7f4e24103760 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e237fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e237fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50592/0 (socket says 172.21.15.100:50592) 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.324+0000 7f4e237fe640 1 -- 172.21.15.100:0/4287658367 learned_addr learned my addr 172.21.15.100:0/4287658367 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102db0 0x7f4e241985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e227fc640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e24103760 0x7f4e24198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e237fe640 1 -- 172.21.15.100:0/4287658367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e24103760 msgr2=0x7f4e24198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e237fe640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e24103760 0x7f4e24198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e237fe640 1 -- 172.21.15.100:0/4287658367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102db0 msgr2=0x7f4e241985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e237fe640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102db0 0x7f4e241985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e237fe640 1 -- 172.21.15.100:0/4287658367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2419d580 con 0x7f4e241082e0 2024-09-12T02:08:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e237fe640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2419cea0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c005cc0 tx=0x7f4e1c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e28928640 1 -- 172.21.15.100:0/4287658367 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c004450 con 0x7f4e241082e0 2024-09-12T02:08:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.325+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2419d810 con 0x7f4e241082e0 2024-09-12T02:08:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.326+0000 7f4e28928640 1 -- 172.21.15.100:0/4287658367 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e1c003e10 con 0x7f4e241082e0 2024-09-12T02:08:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.326+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e24100940 con 0x7f4e241082e0 2024-09-12T02:08:16.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.326+0000 7f4e28928640 1 -- 172.21.15.100:0/4287658367 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c046480 con 0x7f4e241082e0 2024-09-12T02:08:16.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.328+0000 7f4e2bd03740 1 Processor -- start 2024-09-12T02:08:16.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e28928640 1 -- 172.21.15.100:0/4287658367 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4e1c03a400 con 0x7f4e241082e0 2024-09-12T02:08:16.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e2bd03740 1 -- start start 2024-09-12T02:08:16.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d5e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d69140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d69680 0x55b7d0d6ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7d0cc42e0 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b7d0c6bce0 con 0x55b7d0d5edc0 2024-09-12T02:08:16.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7d0cc02a0 con 0x55b7d0d69680 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e227fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d5e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e227fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d5e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50604/0 (socket says 172.21.15.100:50604) 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e227fc640 1 -- 172.21.15.100:0/1624060981 learned_addr learned my addr 172.21.15.100:0/1624060981 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d69140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e28928640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4e0c0a2c00 0x7f4e0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.329+0000 7f4e227fc640 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d69680 0x55b7d0d6ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e28928640 1 -- 172.21.15.100:0/4287658367 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4e1c02e030 con 0x7f4e241082e0 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e227fc640 1 -- 172.21.15.100:0/1624060981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d69680 msgr2=0x55b7d0d6ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e227fc640 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d69680 0x55b7d0d6ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e227fc640 1 -- 172.21.15.100:0/1624060981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 msgr2=0x55b7d0d69140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e227fc640 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d69140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e227fc640 1 -- 172.21.15.100:0/1624060981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7d0c50440 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d69140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:16.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e237fe640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4e0c0a2c00 0x7f4e0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e227fc640 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d5e880 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4e18013860 tx=0x7f4e1800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f27b20b5197c89f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:16.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e09ffb640 1 -- 172.21.15.100:0/1624060981 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e180110d0 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e09ffb640 1 -- 172.21.15.100:0/1624060981 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e18005020 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.330+0000 7f4e09ffb640 1 -- 172.21.15.100:0/1624060981 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18004a00 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 -- 172.21.15.100:0/1624060981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d5e4a0 msgr2=0x55b7d0d5e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e237fe640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4e0c0a2c00 0x7f4e0c0a50c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c006010 tx=0x7f4e1c030b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d5e880 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4e18013860 tx=0x7f4e1800a6e0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 -- 172.21.15.100:0/1624060981 shutdown_connections 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d69680 0x55b7d0d6ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d69140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/1624060981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d5e880 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 -- 172.21.15.100:0/1624060981 >> 172.21.15.100:0/1624060981 conn(0x55b7d0d5aa30 msgr2=0x55b7d0d5ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 -- 172.21.15.100:0/1624060981 shutdown_connections 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.331+0000 7f4e2bd03740 1 -- 172.21.15.100:0/1624060981 wait complete. 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 -- start start 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 Processor -- start 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d68f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d66200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d66740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7d0d6c250 con 0x55b7d0d69680 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b7d0c7f050 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7d0d6c3d0 con 0x55b7d0d5edc0 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.332+0000 7f4e2bd03740 10 client.0 _ll_register_callbacks cb 0x55b7d0cbf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d66200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d66200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:39596/0 (socket says 172.21.15.100:39596) 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 -- 172.21.15.100:0/2699029430 learned_addr learned my addr 172.21.15.100:0/2699029430 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e227fc640 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d66740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e227fc640 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d68f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 -- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 msgr2=0x55b7d0d68f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d68f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 -- 172.21.15.100:0/2699029430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 msgr2=0x55b7d0d66740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d66740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 -- 172.21.15.100:0/2699029430 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7d0a353c0 con 0x55b7d0d5edc0 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d66200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009ee0 tx=0x7f4e14011630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a42fb5d65fd9c776 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e02ffd640 1 -- 172.21.15.100:0/2699029430 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14019070 con 0x55b7d0d5edc0 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e18005020 con 0x55b7d0d5edc0 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.333+0000 7f4e02ffd640 1 -- 172.21.15.100:0/2699029430 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4e14015660 con 0x55b7d0d5edc0 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e02ffd640 1 -- 172.21.15.100:0/2699029430 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e14025050 con 0x55b7d0d5edc0 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 10 client.25036 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:16.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b7d0d77d10 con 0x55b7d0d5edc0 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e02ffd640 1 -- 172.21.15.100:0/2699029430 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e18005020 con 0x55b7d0d5edc0 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e02ffd640 1 -- 172.21.15.100:0/2699029430 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e14014a70 con 0x55b7d0d5edc0 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 10 client.25036 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 10 client.25036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 20 client.25036 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0d7b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 4 client.25036 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.334+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7d0cd1850 con 0x55b7d0d791c0 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.335+0000 7f4e227fc640 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0d7b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.335+0000 7f4e227fc640 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0d7b5e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d7168d74b84e1a server_cookie=c5e5506f8c75aa36 in_seq=0 out_seq=0 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.335+0000 7f4e02ffd640 10 client.25036 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e02ffd640 1 -- 172.21.15.100:0/2699029430 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7d0cd1850 con 0x55b7d0d791c0 2024-09-12T02:08:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e02ffd640 10 client.25036 handle_command_reply: tid=0 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 client.25036 shutdown 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 msgr2=0x55b7d0d66200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d66200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009ee0 tx=0x7f4e14011630 comp rx=0 tx=0).stop 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 shutdown_connections 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0d7b5e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e02ffd640 0 client.25036 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d66740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d66200 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/2699029430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d68f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 >> 172.21.15.100:0/2699029430 conn(0x55b7d0d5aa30 msgr2=0x55b7d0d60760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 shutdown_connections 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 1 -- 172.21.15.100:0/2699029430 wait complete. 2024-09-12T02:08:16.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.336+0000 7f4e2bd03740 20 client.25036 trim_cache size 0 max 16384 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 Processor -- start 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 -- start start 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d75540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d64ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d80e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4e10010cc0 con 0x55b7d0d69680 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1000e590 con 0x55b7d0d5edc0 2024-09-12T02:08:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.353+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1000c3e0 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d80e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d80e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50618/0 (socket says 172.21.15.100:50618) 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 -- 172.21.15.100:0/3773919770 learned_addr learned my addr 172.21.15.100:0/3773919770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d75540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d64ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 -- 172.21.15.100:0/3773919770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5e4a0 msgr2=0x55b7d0d75540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d75540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 -- 172.21.15.100:0/3773919770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 msgr2=0x55b7d0d64ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d64ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 -- 172.21.15.100:0/3773919770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7d0d5a860 con 0x55b7d0d69680 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e227fc640 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d80e90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4e180133b0 tx=0x7f4e18023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf55eb23662c87ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e097fa640 1 -- 172.21.15.100:0/3773919770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18011190 con 0x55b7d0d69680 2024-09-12T02:08:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e097fa640 1 -- 172.21.15.100:0/3773919770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e18011c90 con 0x55b7d0d69680 2024-09-12T02:08:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.354+0000 7f4e097fa640 1 -- 172.21.15.100:0/3773919770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800fae0 con 0x55b7d0d69680 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.355+0000 7f4e2bd03740 1 -- 172.21.15.100:0/3773919770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 msgr2=0x55b7d0d80e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.355+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d80e90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4e180133b0 tx=0x7f4e18023040 comp rx=0 tx=0).stop 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.355+0000 7f4e2bd03740 1 -- 172.21.15.100:0/3773919770 shutdown_connections 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.355+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d80e90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.355+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d64ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.355+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/3773919770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d75540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.355+0000 7f4e2bd03740 1 -- 172.21.15.100:0/3773919770 >> 172.21.15.100:0/3773919770 conn(0x55b7d0d5aa30 msgr2=0x55b7d0d68280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.356+0000 7f4e2bd03740 1 -- 172.21.15.100:0/3773919770 shutdown_connections 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.356+0000 7f4e2bd03740 1 -- 172.21.15.100:0/3773919770 wait complete. 2024-09-12T02:08:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.356+0000 7f4e2bd03740 1 -- start start 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.356+0000 7f4e2bd03740 1 Processor -- start 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e2bd03740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d63d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1000ca50 con 0x55b7d0d69680 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1000dec0 con 0x55b7d0d5e4a0 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e2bd03740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1000d120 con 0x55b7d0d5edc0 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e2bd03740 10 client.0 _ll_register_callbacks cb 0x7f4e14009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d63d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d63d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50624/0 (socket says 172.21.15.100:50624) 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 -- 172.21.15.100:0/987452580 learned_addr learned my addr 172.21.15.100:0/987452580 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 -- 172.21.15.100:0/987452580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 msgr2=0x55b7d0d637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d637e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 -- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 msgr2=0x55b7d0d632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e227fc640 1 -- 172.21.15.100:0/987452580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7d0d67240 con 0x55b7d0d69680 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.357+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e227fc640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d63d20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011220 tx=0x7f4e18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42229fbed5f9157 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e02ffd640 1 -- 172.21.15.100:0/987452580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1803f060 con 0x55b7d0d69680 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e02ffd640 1 -- 172.21.15.100:0/987452580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4e1800f650 con 0x55b7d0d69680 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e18011c90 con 0x55b7d0d69680 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e02ffd640 1 -- 172.21.15.100:0/987452580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e1800f850 con 0x55b7d0d69680 2024-09-12T02:08:16.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 10 client.15603 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b7d0d5bae0 con 0x55b7d0d69680 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e02ffd640 1 -- 172.21.15.100:0/987452580 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e18011c90 con 0x55b7d0d69680 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e02ffd640 1 -- 172.21.15.100:0/987452580 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e1801d040 con 0x55b7d0d69680 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 10 client.15603 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 20 client.15603 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0de63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 4 client.15603 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.358+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b7d0ccbd60 con 0x55b7d0d791c0 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.359+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0de63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.359+0000 7f4e22ffd640 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0de63a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5850015877fce19 server_cookie=9a3eee28ca123c9d in_seq=0 out_seq=0 2024-09-12T02:08:16.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.359+0000 7f4e02ffd640 10 client.15603 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.359+0000 7f4e02ffd640 1 -- 172.21.15.100:0/987452580 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b7d0ccbd60 con 0x55b7d0d791c0 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.359+0000 7f4e02ffd640 10 client.15603 handle_command_reply: tid=0 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.359+0000 7f4e2bd03740 1 client.15603 shutdown 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 msgr2=0x55b7d0d63d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d63d20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011220 tx=0x7f4e18000bc0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 shutdown_connections 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55b7d0d791c0 0x55b7d0de63a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7d0d69680 0x55b7d0d63d20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e02ffd640 0 client.15603 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7d0d5edc0 0x55b7d0d637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 --2- 172.21.15.100:0/987452580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b7d0d5e4a0 0x55b7d0d632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 >> 172.21.15.100:0/987452580 conn(0x55b7d0d5aa30 msgr2=0x55b7d0d59350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 shutdown_connections 2024-09-12T02:08:16.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 1 -- 172.21.15.100:0/987452580 wait complete. 2024-09-12T02:08:16.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.360+0000 7f4e2bd03740 20 client.15603 trim_cache size 0 max 16384 2024-09-12T02:08:16.366 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:08:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:08:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:08:16.366 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4e0c0a2c00 msgr2=0x7f4e0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4e0c0a2c00 0x7f4e0c0a50c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c006010 tx=0x7f4e1c030b50 comp rx=0 tx=0).stop 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 msgr2=0x7f4e2419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2419cea0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c005cc0 tx=0x7f4e1c003c20 comp rx=0 tx=0).stop 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 shutdown_connections 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4e0c0a2c00 0x7f4e0c0a50c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e241082e0 0x7f4e2419cea0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e24103760 0x7f4e24198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 --2- 172.21.15.100:0/4287658367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102db0 0x7f4e241985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:16.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 >> 172.21.15.100:0/4287658367 conn(0x7f4e240fc7d0 msgr2=0x7f4e240fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:16.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 shutdown_connections 2024-09-12T02:08:16.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:16.361+0000 7f4e2992a640 1 -- 172.21.15.100:0/4287658367 wait complete. 2024-09-12T02:08:17.000 INFO:tasks.workunit.client.0.smithi100.stdout:.......... 2024-09-12T02:08:17.000 INFO:tasks.workunit.client.0.smithi100.stdout:do_o_direct_reads: SUCCESS 2024-09-12T02:08:17.002 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:08:17.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:08:17.076 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-09-12T02:08:17.076 DEBUG:teuthology.orchestra.run.smithi100:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-09-12T02:08:17.137 INFO:tasks.workunit.client.0.smithi100.stdout:test read from hole 2024-09-12T02:08:17.137 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test read from hole' 2024-09-12T02:08:17.138 INFO:tasks.workunit.client.0.smithi100.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-09-12T02:08:17.139 INFO:tasks.workunit.client.0.smithi100.stderr:0+0 records in 2024-09-12T02:08:17.139 INFO:tasks.workunit.client.0.smithi100.stderr:0+0 records out 2024-09-12T02:08:17.139 INFO:tasks.workunit.client.0.smithi100.stderr:0 bytes copied, 3.286e-05 s, 0.0 kB/s 2024-09-12T02:08:17.139 INFO:tasks.workunit.client.0.smithi100.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-09-12T02:08:17.141 INFO:tasks.workunit.client.0.smithi100.stderr:2+0 records in 2024-09-12T02:08:17.141 INFO:tasks.workunit.client.0.smithi100.stderr:2+0 records out 2024-09-12T02:08:17.142 INFO:tasks.workunit.client.0.smithi100.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000986056 s, 1.0 MB/s 2024-09-12T02:08:17.142 INFO:tasks.workunit.client.0.smithi100.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-09-12T02:08:17.142 INFO:tasks.workunit.client.0.smithi100.stderr:2+0 records in 2024-09-12T02:08:17.142 INFO:tasks.workunit.client.0.smithi100.stderr:2+0 records out 2024-09-12T02:08:17.142 INFO:tasks.workunit.client.0.smithi100.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.937e-05 s, 26.0 MB/s 2024-09-12T02:08:17.142 INFO:tasks.workunit.client.0.smithi100.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-09-12T02:08:17.142 INFO:tasks.workunit.client.0.smithi100.stdout:other thing 2024-09-12T02:08:17.143 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'other thing' 2024-09-12T02:08:17.143 INFO:tasks.workunit.client.0.smithi100.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-09-12T02:08:17.143 INFO:tasks.workunit.client.0.smithi100.stderr:1+0 records in 2024-09-12T02:08:17.143 INFO:tasks.workunit.client.0.smithi100.stderr:1+0 records out 2024-09-12T02:08:17.143 INFO:tasks.workunit.client.0.smithi100.stderr:500 bytes copied, 3.9479e-05 s, 12.7 MB/s 2024-09-12T02:08:17.143 INFO:tasks.workunit.client.0.smithi100.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-09-12T02:08:17.153 INFO:tasks.workunit.client.0.smithi100.stderr:0+1 records in 2024-09-12T02:08:17.154 INFO:tasks.workunit.client.0.smithi100.stderr:0+1 records out 2024-09-12T02:08:17.154 INFO:tasks.workunit.client.0.smithi100.stderr:500 bytes copied, 0.00523255 s, 95.6 kB/s 2024-09-12T02:08:17.154 INFO:tasks.workunit.client.0.smithi100.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-09-12T02:08:17.154 INFO:tasks.workunit.client.0.smithi100.stderr:0+1 records in 2024-09-12T02:08:17.154 INFO:tasks.workunit.client.0.smithi100.stderr:0+1 records out 2024-09-12T02:08:17.154 INFO:tasks.workunit.client.0.smithi100.stderr:500 bytes copied, 0.00291896 s, 171 kB/s 2024-09-12T02:08:17.154 INFO:tasks.workunit.client.0.smithi100.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-09-12T02:08:17.155 INFO:tasks.workunit.client.0.smithi100.stdout:OK 2024-09-12T02:08:17.156 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo OK 2024-09-12T02:08:17.156 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:08:17.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:08:17.234 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:08:17.234 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:08:17.235 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-09-12T02:08:17.235 DEBUG:teuthology.orchestra.run.smithi100:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-09-12T02:08:17.297 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:17 smithi100 ceph-mon[31179]: pgmap v369: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.68k op/s 2024-09-12T02:08:17.306 INFO:tasks.workunit.client.0.smithi100.stdout:writing first 3 bytes of 10k file 2024-09-12T02:08:17.306 INFO:tasks.workunit.client.0.smithi100.stdout:reading O_DIRECT 2024-09-12T02:08:17.306 INFO:tasks.workunit.client.0.smithi100.stdout:got 10000 2024-09-12T02:08:17.306 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:08:17.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:08:17.381 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-09-12T02:08:17.382 DEBUG:teuthology.orchestra.run.smithi100:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-09-12T02:08:17.528 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:17.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:17 smithi189 ceph-mon[35188]: pgmap v369: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.68k op/s 2024-09-12T02:08:17.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:17 smithi117 ceph-mon[35240]: pgmap v369: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.4 MiB/s wr, 1.68k op/s 2024-09-12T02:08:18.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/2915637997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38103780 msgr2=0x7f1d38107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/2915637997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38103780 0x7f1d38107bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009930 tx=0x7f1d2802a420 comp rx=0 tx=0).stop 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/2915637997 shutdown_connections 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/2915637997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d38108300 0x7f1d3810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/2915637997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38103780 0x7f1d38107bc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/2915637997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d38102dd0 0x7f1d381031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/2915637997 >> 172.21.15.100:0/2915637997 conn(0x7f1d380fc7d0 msgr2=0x7f1d380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/2915637997 shutdown_connections 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.007+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/2915637997 wait complete. 2024-09-12T02:08:18.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 Processor -- start 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 -- start start 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38102dd0 0x7f1d38198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d38103780 0x7f1d38198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d38108300 0x7f1d3819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1d381120d0 con 0x7f1d38102dd0 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1d38111f50 con 0x7f1d38108300 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3f9b5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1d38112250 con 0x7f1d38103780 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3d751640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38102dd0 0x7f1d38198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3d751640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38102dd0 0x7f1d38198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50636/0 (socket says 172.21.15.100:50636) 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.008+0000 7f1d3d751640 1 -- 172.21.15.100:0/3850838671 learned_addr learned my addr 172.21.15.100:0/3850838671 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3df52640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d38108300 0x7f1d3819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3cf50640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d38103780 0x7f1d38198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3d751640 1 -- 172.21.15.100:0/3850838671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d38103780 msgr2=0x7f1d38198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3d751640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d38103780 0x7f1d38198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3d751640 1 -- 172.21.15.100:0/3850838671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d38108300 msgr2=0x7f1d3819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3d751640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d38108300 0x7f1d3819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3d751640 1 -- 172.21.15.100:0/3850838671 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3819d620 con 0x7f1d38102dd0 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3d751640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38102dd0 0x7f1d38198670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400c890 tx=0x7f1d3400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d2e7fc640 1 -- 172.21.15.100:0/3850838671 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34004220 con 0x7f1d38102dd0 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3819d910 con 0x7f1d38102dd0 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d2e7fc640 1 -- 172.21.15.100:0/3850838671 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d340043c0 con 0x7f1d38102dd0 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d2e7fc640 1 -- 172.21.15.100:0/3850838671 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d340049e0 con 0x7f1d38102dd0 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.009+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d381a51f0 con 0x7f1d38102dd0 2024-09-12T02:08:18.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.010+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d381031b0 con 0x7f1d38102dd0 2024-09-12T02:08:18.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.012+0000 7f1d2e7fc640 1 -- 172.21.15.100:0/3850838671 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1d340079b0 con 0x7f1d38102dd0 2024-09-12T02:08:18.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.013+0000 7f1d2e7fc640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1d240a2b80 0x7f1d240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:18.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.013+0000 7f1d2e7fc640 1 -- 172.21.15.100:0/3850838671 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1d340ced90 con 0x7f1d38102dd0 2024-09-12T02:08:18.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.013+0000 7f1d3cf50640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1d240a2b80 0x7f1d240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:18.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.013+0000 7f1d3cf50640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1d240a2b80 0x7f1d240a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009230 tx=0x7f1d28000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:18.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.017+0000 7f1d2e7fc640 1 -- 172.21.15.100:0/3850838671 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d34014030 con 0x7f1d38102dd0 2024-09-12T02:08:18.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.225+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d381999d0 con 0x7f1d38102dd0 2024-09-12T02:08:18.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.226+0000 7f1d2e7fc640 1 -- 172.21.15.100:0/3850838671 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11929 (secure 0 0 0) 0x7f1d3409bd00 con 0x7f1d38102dd0 2024-09-12T02:08:18.226 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:08:18.226 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-12T02:06:46:225257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:06:45.807648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:08:18.227 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-12T02:08:18.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.228+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1d240a2b80 msgr2=0x7f1d240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:18.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.228+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1d240a2b80 0x7f1d240a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009230 tx=0x7f1d28000bc0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.228+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38102dd0 msgr2=0x7f1d38198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:18.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.228+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38102dd0 0x7f1d38198670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400c890 tx=0x7f1d3400cd50 comp rx=0 tx=0).stop 2024-09-12T02:08:18.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 shutdown_connections 2024-09-12T02:08:18.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1d240a2b80 0x7f1d240a5040 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d38108300 0x7f1d3819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d38103780 0x7f1d38198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 --2- 172.21.15.100:0/3850838671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d38102dd0 0x7f1d38198670 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:18.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 >> 172.21.15.100:0/3850838671 conn(0x7f1d380fc7d0 msgr2=0x7f1d38105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:18.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 shutdown_connections 2024-09-12T02:08:18.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:18.229+0000 7f1d3f9b5640 1 -- 172.21.15.100:0/3850838671 wait complete. 2024-09-12T02:08:18.677 INFO:tasks.workunit.client.0.smithi100.stdout:writing pattern 2024-09-12T02:08:18.677 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-09-12T02:08:18.677 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-12T02:08:18.677 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-09-12T02:08:18.678 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-12T02:08:18.679 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-09-12T02:08:18.679 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-12T02:08:18.679 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-09-12T02:08:18.679 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-12T02:08:18.679 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-09-12T02:08:18.679 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-12T02:08:18.680 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:18.680 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:18.680 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:18.680 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:18.680 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:18.680 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:18.681 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:18.682 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:18.682 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:18.682 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:18.682 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:18.682 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:18.682 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:18.683 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:18.683 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:18.683 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:18.683 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:18.683 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:18.684 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:18.684 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:18.684 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:18.684 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:18.684 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:18.684 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:18.685 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:18.685 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:18.685 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:18.685 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:18.685 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:18.685 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:18.685 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:18.686 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:18.688 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:18.699 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:18.699 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:18.699 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:18.700 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:18.701 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:18.702 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:18.703 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:18.704 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:18.705 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:18.706 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:18.710 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:18.711 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:18.712 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:18.713 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:18.714 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:18.715 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:18.716 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:18.717 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:18.721 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:18.721 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:18.721 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:18.721 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:18.722 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:18.723 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:18.724 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:18.725 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:18.725 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:18.725 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:18.725 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:18.725 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:18.728 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-12T02:08:18.729 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:18.730 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:18.731 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:18.731 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:18.731 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:18.731 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:18.739 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:18.740 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:18.741 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:18.742 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:18.743 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:18.744 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:18.745 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:18.755 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:18.755 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:18.755 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:18.755 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:18.755 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:18.756 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:18.757 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:18.758 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:18.759 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:18.760 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:18.766 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:18.766 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:18.767 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:18.768 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:18.769 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:18.770 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:18.772 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:18.785 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:18.785 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:18.787 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:18.789 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:18.789 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:18.789 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:18.789 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:18.789 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:18.789 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:18.789 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-09-12T02:08:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:18.791 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:18.792 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:18.799 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:18.800 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:18.801 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:18.802 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:18.803 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:18.804 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:18.805 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:18.814 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:18.815 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:18.817 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:18.818 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:18.819 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:18.820 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:18.824 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:18.825 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:18.825 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:18.825 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:18.825 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:18.825 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:18.825 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:18.825 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:18.826 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:18.830 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:18.831 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:18.831 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:18.831 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:18.831 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:18.831 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:18.832 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:18.832 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:18.832 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:18.832 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:18.832 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:18.832 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:18.833 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:18.833 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:18.833 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:18.833 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:18.833 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:18.834 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:18.834 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:18.834 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:18.834 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:18.834 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:18.834 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:18.834 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:18.837 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:18.838 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-09-12T02:08:18.839 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-09-12T02:08:18.840 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-12T02:08:18.841 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-09-12T02:08:18.841 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:18.842 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:18.843 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:18.844 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:18.855 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:18.855 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:18.855 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:18.856 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:18.857 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:18.858 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:18.859 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:18.861 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:18.863 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:18.870 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:18.872 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:18.874 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:18.876 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:18.876 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:18.876 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:18.876 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:18.876 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:18.879 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:18.879 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:18.879 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:18.879 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:18.881 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:18.882 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:18.883 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:18.885 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:18.894 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-12T02:08:18.895 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-12T02:08:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:18.897 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:18.898 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:18.899 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:18.900 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:18.911 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:18.911 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:18.912 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:18.913 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:18.915 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:18.916 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:18.917 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:18.923 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:18.924 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:18.926 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:18.927 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:18.928 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:18.930 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:18.930 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:18.930 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:18.933 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:18.933 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:18.933 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:18.933 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:18.933 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:18.934 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:18.935 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:18.937 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:18.938 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:18.939 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-09-12T02:08:18.949 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-12T02:08:18.950 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:18.951 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:18.952 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:18.953 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:18.954 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:18.955 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:18.955 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:18.955 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:18.955 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:18.955 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:18.955 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:18.970 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:18.971 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:18.972 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:18.974 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:18.975 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:18.976 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:18.980 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:18.980 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:18.980 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:18.980 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:18.980 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:18.981 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:18.982 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:18.983 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:18.985 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:18.986 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:18.987 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:18.987 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:18.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:08:18.990 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:18.990 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:18.990 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:18.991 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:18.992 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:18.993 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:18.994 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:18.995 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:18.996 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:19.006 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-12T02:08:19.007 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:19.008 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:19.009 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:19.010 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:19.011 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:19.012 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:19.013 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:19.025 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:19.025 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:19.025 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:19.026 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:19.027 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:19.029 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:19.030 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:19.031 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:19.035 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:19.035 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:19.035 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:19.035 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:19.035 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:19.035 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:19.035 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:19.036 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:19.037 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:19.040 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:19.041 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:19.045 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:19.045 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:19.045 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:19.045 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:19.045 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:19.045 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:19.046 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:19.047 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:19.048 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:19.049 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:19.050 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-09-12T02:08:19.051 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-12T02:08:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:19.065 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:19.066 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:19.067 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:19.080 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:19.081 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:19.082 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:19.083 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:19.084 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:19.086 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:19.088 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:19.089 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:19.090 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:19.092 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:19.093 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:19.095 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:19.095 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:19.095 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:19.250 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:19.281 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:19.284 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:19.285 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:19.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:19.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:19.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-12T02:08:19.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:19.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:19.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:19.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-12T02:08:19.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:19.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:19.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:19.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-12T02:08:19.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:19 smithi100 ceph-mon[31179]: pgmap v370: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 3.65k op/s 2024-09-12T02:08:19.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:19 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3850838671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:08:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:19 smithi189 ceph-mon[35188]: pgmap v370: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 3.65k op/s 2024-09-12T02:08:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:19 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3850838671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:08:19.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:19 smithi117 ceph-mon[35240]: pgmap v370: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 3.65k op/s 2024-09-12T02:08:19.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:19 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3850838671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:08:19.990 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:19.991 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:19.992 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:19.993 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:19.994 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:19.995 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:19.996 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-12T02:08:19.997 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:19.997 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:19.997 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 -- 172.21.15.100:0/3962871201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c10c160 msgr2=0x7f726c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 --2- 172.21.15.100:0/3962871201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c10c160 0x7f726c10e600 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7264009ca0 tx=0x7f726402a950 comp rx=0 tx=0).stop 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 -- 172.21.15.100:0/3962871201 shutdown_connections 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 --2- 172.21.15.100:0/3962871201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c10c160 0x7f726c10e600 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 --2- 172.21.15.100:0/3962871201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c103650 0x7f726c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 --2- 172.21.15.100:0/3962871201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f726c102d30 0x7f726c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 -- 172.21.15.100:0/3962871201 >> 172.21.15.100:0/3962871201 conn(0x7f726c0fc7d0 msgr2=0x7f726c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 -- 172.21.15.100:0/3962871201 shutdown_connections 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 -- 172.21.15.100:0/3962871201 wait complete. 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.989+0000 7f7274415640 1 Processor -- start 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f7274415640 1 -- start start 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f7274415640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f726c102d30 0x7f726c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f7274415640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c103650 0x7f726c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f7274415640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c10c160 0x7f726c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f7274415640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f726c111f60 con 0x7f726c103650 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f7274415640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f726c111de0 con 0x7f726c10c160 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f7274415640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1120e0 con 0x7f726c102d30 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c103650 0x7f726c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c103650 0x7f726c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50656/0 (socket says 172.21.15.100:50656) 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 -- 172.21.15.100:0/1249318836 learned_addr learned my addr 172.21.15.100:0/1249318836 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72721b1640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f726c102d30 0x7f726c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72729b2640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c10c160 0x7f726c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 -- 172.21.15.100:0/1249318836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f726c102d30 msgr2=0x7f726c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f726c102d30 0x7f726c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 -- 172.21.15.100:0/1249318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c10c160 msgr2=0x7f726c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c10c160 0x7f726c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 -- 172.21.15.100:0/1249318836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c19d420 con 0x7f726c103650 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72719b0640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c103650 0x7f726c1989b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f725c00d950 tx=0x7f725c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.990+0000 7f72637fe640 1 -- 172.21.15.100:0/1249318836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c017030 con 0x7f726c103650 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.991+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c19d710 con 0x7f726c103650 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.991+0000 7f72637fe640 1 -- 172.21.15.100:0/1249318836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f725c004020 con 0x7f726c103650 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.991+0000 7f72637fe640 1 -- 172.21.15.100:0/1249318836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0047a0 con 0x7f726c103650 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.991+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1a4ff0 con 0x7f726c103650 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.993+0000 7f72637fe640 1 -- 172.21.15.100:0/1249318836 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f725c0041d0 con 0x7f726c103650 2024-09-12T02:08:20.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.993+0000 7f72767ee740 1 Processor -- start 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.993+0000 7f72637fe640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72580a2b80 0x7f72580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72637fe640 1 -- 172.21.15.100:0/1249318836 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f725c0ce8c0 con 0x7f726c103650 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72767ee740 1 -- start start 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72729b2640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72580a2b80 0x7f72580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72767ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c670624090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72767ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c670624a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72767ee740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c670631760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72767ee740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c67058a2f0 con 0x55c67062f370 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72767ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c670531cf0 con 0x55c670625b40 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72767ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c6705862b0 con 0x55c6706245d0 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72719b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c670624a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72721b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c670624090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72729b2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c670631760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72719b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c670624a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:39644/0 (socket says 172.21.15.100:39644) 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.994+0000 7f72719b0640 1 -- 172.21.15.100:0/2268869646 learned_addr learned my addr 172.21.15.100:0/2268869646 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72719b0640 1 -- 172.21.15.100:0/2268869646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 msgr2=0x55c670624090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72719b0640 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c670624090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72719b0640 1 -- 172.21.15.100:0/2268869646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 msgr2=0x55c670631760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72719b0640 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c670631760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72719b0640 1 -- 172.21.15.100:0/2268869646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6705163a0 con 0x55c6706245d0 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72729b2640 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c670631760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72729b2640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72580a2b80 0x7f72580a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55c670625070 tx=0x7f7264005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f72719b0640 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c670624a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f725c0a3870 tx=0x7f725c09ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca7c1bca0a1bc694 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f7260dea640 1 -- 172.21.15.100:0/2268869646 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c09b130 con 0x55c6706245d0 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f7260dea640 1 -- 172.21.15.100:0/2268869646 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f725c09f4e0 con 0x55c6706245d0 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.995+0000 7f7260dea640 1 -- 172.21.15.100:0/2268869646 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0bb070 con 0x55c6706245d0 2024-09-12T02:08:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 -- 172.21.15.100:0/2268869646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 msgr2=0x55c670624a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c670624a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f725c0a3870 tx=0x7f725c09ad30 comp rx=0 tx=0).stop 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 -- 172.21.15.100:0/2268869646 shutdown_connections 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c670631760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c670624a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 --2- 172.21.15.100:0/2268869646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c670624090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 -- 172.21.15.100:0/2268869646 >> 172.21.15.100:0/2268869646 conn(0x55c6705ed310 msgr2=0x55c670620c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 -- 172.21.15.100:0/2268869646 shutdown_connections 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.996+0000 7f72767ee740 1 -- 172.21.15.100:0/2268869646 wait complete. 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 -- start start 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 Processor -- start 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c67062edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c67062c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c67062c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c670632070 con 0x55c67062f370 2024-09-12T02:08:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c670545060 con 0x55c670625b40 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c6706321f0 con 0x55c6706245d0 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72767ee740 10 client.0 _ll_register_callbacks cb 0x55c6702988c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72729b2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c67062c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72721b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c67062edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72719b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c67062c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72721b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c67062edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:39654/0 (socket says 172.21.15.100:39654) 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72719b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c67062c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:47400/0 (socket says 172.21.15.100:47400) 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72721b1640 1 -- 172.21.15.100:0/3425502120 learned_addr learned my addr 172.21.15.100:0/3425502120 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72719b0640 1 -- 172.21.15.100:0/3425502120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 msgr2=0x55c67062edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72719b0640 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c67062edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72719b0640 1 -- 172.21.15.100:0/3425502120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 msgr2=0x55c67062c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72719b0640 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c67062c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.997+0000 7f72719b0640 1 -- 172.21.15.100:0/3425502120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6702fb3c0 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72719b0640 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c67062c060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f725c004770 tx=0x7f725c09ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d3fdb5de1bd2b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f7255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f7255ffb640 1 -- 172.21.15.100:0/3425502120 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c09b130 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f7255ffb640 1 -- 172.21.15.100:0/3425502120 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f725c09f160 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f725c09f4e0 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f7255ffb640 1 -- 172.21.15.100:0/3425502120 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f725c07e050 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 10 client.25130 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c67063db60 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f7255ffb640 1 -- 172.21.15.100:0/3425502120 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f725c09f4e0 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f7255ffb640 1 -- 172.21.15.100:0/3425502120 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f725c099ff0 con 0x55c670625b40 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 10 client.25130 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 10 client.25130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 20 client.25130 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:20.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c67063eeb0 0x55c6706412a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 4 client.25130 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.998+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c670597860 con 0x55c67063eeb0 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.999+0000 7f72721b1640 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c67063eeb0 0x55c6706412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.999+0000 7f72721b1640 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c67063eeb0 0x55c6706412a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b1bc89dedb22b50 server_cookie=6082ed3ee544d1f in_seq=0 out_seq=0 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:19.999+0000 7f7255ffb640 10 client.25130 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f7255ffb640 1 -- 172.21.15.100:0/3425502120 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c670597860 con 0x55c67063eeb0 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f7255ffb640 10 client.25130 handle_command_reply: tid=0 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 client.25130 shutdown 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 msgr2=0x55c67062c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c67062c060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f725c004770 tx=0x7f725c09ada0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 shutdown_connections 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c67063eeb0 0x55c6706412a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c67062f370 0x55c67062c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f7255ffb640 0 client.25130 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:08:20.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c67062c060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 --2- 172.21.15.100:0/3425502120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c6706245d0 0x55c67062edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 >> 172.21.15.100:0/3425502120 conn(0x55c6705ed310 msgr2=0x55c670626960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:20.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 shutdown_connections 2024-09-12T02:08:20.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 1 -- 172.21.15.100:0/3425502120 wait complete. 2024-09-12T02:08:20.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.000+0000 7f72767ee740 20 client.25130 trim_cache size 0 max 16384 2024-09-12T02:08:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.017+0000 7f72767ee740 1 Processor -- start 2024-09-12T02:08:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.017+0000 7f72767ee740 1 -- start start 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72767ee740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c67062c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72767ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c6706442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72767ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c67062f370 0x55c670644800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72767ee740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1afe00 con 0x55c6706245d0 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72767ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1ad6d0 con 0x55c670625b40 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72767ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1ab520 con 0x55c67062f370 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c67062c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c67062c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50686/0 (socket says 172.21.15.100:50686) 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 -- 172.21.15.100:0/2233271508 learned_addr learned my addr 172.21.15.100:0/2233271508 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72719b0640 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c6706442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72729b2640 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c67062f370 0x55c670644800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 -- 172.21.15.100:0/2233271508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c67062f370 msgr2=0x55c670644800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c67062f370 0x55c670644800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 -- 172.21.15.100:0/2233271508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 msgr2=0x55c6706442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c6706442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 -- 172.21.15.100:0/2233271508 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c670621960 con 0x55c6706245d0 2024-09-12T02:08:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f72721b1640 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c67062c030 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55c6705862e0 tx=0x7f72680108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abf168e83c8d45f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.018+0000 7f7257fff640 1 -- 172.21.15.100:0/2233271508 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268005220 con 0x55c6706245d0 2024-09-12T02:08:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f7257fff640 1 -- 172.21.15.100:0/2233271508 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7268004c80 con 0x55c6706245d0 2024-09-12T02:08:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f7257fff640 1 -- 172.21.15.100:0/2233271508 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726801e960 con 0x55c6706245d0 2024-09-12T02:08:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f72767ee740 1 -- 172.21.15.100:0/2233271508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 msgr2=0x55c67062c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f72767ee740 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c67062c030 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55c6705862e0 tx=0x7f72680108d0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f72767ee740 1 -- 172.21.15.100:0/2233271508 shutdown_connections 2024-09-12T02:08:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f72767ee740 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c67062f370 0x55c670644800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f72767ee740 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c670625b40 0x55c6706442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f72767ee740 1 --2- 172.21.15.100:0/2233271508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c67062c030 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.019+0000 7f72767ee740 1 -- 172.21.15.100:0/2233271508 >> 172.21.15.100:0/2233271508 conn(0x55c6705ed310 msgr2=0x55c67062b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 -- 172.21.15.100:0/2233271508 shutdown_connections 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 -- 172.21.15.100:0/2233271508 wait complete. 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 -- start start 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 Processor -- start 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c6706421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c670625b40 0x55c6706426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c67062f370 0x55c670642c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1abb90 con 0x55c6706245d0 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1ad000 con 0x55c67062f370 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1ac260 con 0x55c670625b40 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.020+0000 7f72767ee740 10 client.0 _ll_register_callbacks cb 0x7f7264009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72719b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c670625b40 0x55c6706426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72729b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c67062f370 0x55c670642c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72721b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c6706421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72719b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c670625b40 0x55c6706426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:39678/0 (socket says 172.21.15.100:39678) 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72719b0640 1 -- 172.21.15.100:0/236582822 learned_addr learned my addr 172.21.15.100:0/236582822 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72729b2640 1 -- 172.21.15.100:0/236582822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c670625b40 msgr2=0x55c6706426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72729b2640 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c670625b40 0x55c6706426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72729b2640 1 -- 172.21.15.100:0/236582822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 msgr2=0x55c6706421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72729b2640 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c6706421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72729b2640 1 -- 172.21.15.100:0/236582822 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c670621dd0 con 0x55c67062f370 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72729b2640 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c67062f370 0x55c670642c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7264005cc0 tx=0x7f7264005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c493c8e57288dcf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f7255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f7255ffb640 1 -- 172.21.15.100:0/236582822 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264034040 con 0x55c67062f370 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f7255ffb640 1 -- 172.21.15.100:0/236582822 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f72640044a0 con 0x55c67062f370 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.021+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7268004c80 con 0x55c67062f370 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f7255ffb640 1 -- 172.21.15.100:0/236582822 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f72640046a0 con 0x55c67062f370 2024-09-12T02:08:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 10 client.25136 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c6706ade60 con 0x55c67062f370 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f7255ffb640 1 -- 172.21.15.100:0/236582822 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7268004c80 con 0x55c67062f370 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f7255ffb640 1 -- 172.21.15.100:0/236582822 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7264030440 con 0x55c67062f370 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 10 client.25136 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 10 client.25136 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 20 client.25136 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c6706ae580 0x55c6706b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 4 client.25136 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c670591d70 con 0x55c6706ae580 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.022+0000 7f72721b1640 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c6706ae580 0x55c6706b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f7255ffb640 10 client.25136 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72721b1640 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c6706ae580 0x55c6706b09c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47c256e1b0a3d1e3 server_cookie=9584e00cb711cfac in_seq=0 out_seq=0 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f7255ffb640 1 -- 172.21.15.100:0/236582822 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c670591d70 con 0x55c6706ae580 2024-09-12T02:08:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f7255ffb640 10 client.25136 handle_command_reply: tid=0 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 client.25136 shutdown 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c67062f370 msgr2=0x55c670642c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c67062f370 0x55c670642c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7264005cc0 tx=0x7f7264005c50 comp rx=0 tx=0).stop 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 shutdown_connections 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x55c6706ae580 0x55c6706b09c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c67062f370 0x55c670642c30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c670625b40 0x55c6706426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f7255ffb640 0 client.25136 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 --2- 172.21.15.100:0/236582822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c6706245d0 0x55c6706421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 >> 172.21.15.100:0/236582822 conn(0x55c6705ed310 msgr2=0x55c67063a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 shutdown_connections 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 1 -- 172.21.15.100:0/236582822 wait complete. 2024-09-12T02:08:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.023+0000 7f72767ee740 20 client.25136 trim_cache size 0 max 16384 2024-09-12T02:08:20.029 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:08:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72580a2b80 msgr2=0x7f72580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72580a2b80 0x7f72580a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55c670625070 tx=0x7f7264005ef0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c103650 msgr2=0x7f726c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c103650 0x7f726c1989b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f725c00d950 tx=0x7f725c00de10 comp rx=0 tx=0).stop 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 shutdown_connections 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72580a2b80 0x7f72580a5040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c10c160 0x7f726c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f726c103650 0x7f726c1989b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 --2- 172.21.15.100:0/1249318836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f726c102d30 0x7f726c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 >> 172.21.15.100:0/1249318836 conn(0x7f726c0fc7d0 msgr2=0x7f726c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 shutdown_connections 2024-09-12T02:08:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:20.024+0000 7f7274415640 1 -- 172.21.15.100:0/1249318836 wait complete. 2024-09-12T02:08:20.528 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-12T02:08:20.528 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:20.528 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:20.528 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:20.528 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-12T02:08:20.528 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:20.529 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-12T02:08:20.530 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:20.531 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:20.532 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:20.534 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-12T02:08:20.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-12T02:08:20.931 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-12T02:08:20.932 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:20.933 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:20.935 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:20.937 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:21.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:21 smithi100 ceph-mon[31179]: pgmap v371: 97 pgs: 97 active+clean; 85 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 1.7 MiB/s wr, 3.71k op/s 2024-09-12T02:08:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1953840599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e58106f50 msgr2=0x7f7e5810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1953840599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e58106f50 0x7f7e5810eaf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009cd0 tx=0x7f7e5002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1953840599 shutdown_connections 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1953840599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e58106f50 0x7f7e5810eaf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1953840599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e58100ca0 0x7f7e58106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1953840599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e581002f0 0x7f7e581006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1953840599 >> 172.21.15.100:0/1953840599 conn(0x7f7e58077210 msgr2=0x7f7e580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1953840599 shutdown_connections 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.526+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1953840599 wait complete. 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 Processor -- start 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 -- start start 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e581002f0 0x7f7e58198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e58100ca0 0x7f7e581989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e58106f50 0x7f7e5819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58111ff0 con 0x7f7e581002f0 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58111e70 con 0x7f7e58100ca0 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e5de2d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58112170 con 0x7f7e58106f50 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e581002f0 0x7f7e58198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e581002f0 0x7f7e58198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50720/0 (socket says 172.21.15.100:50720) 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e577fe640 1 -- 172.21.15.100:0/1699732853 learned_addr learned my addr 172.21.15.100:0/1699732853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e58100ca0 0x7f7e581989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.527+0000 7f7e57fff640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e58106f50 0x7f7e5819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e577fe640 1 -- 172.21.15.100:0/1699732853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e58106f50 msgr2=0x7f7e5819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e577fe640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e58106f50 0x7f7e5819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e577fe640 1 -- 172.21.15.100:0/1699732853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e58100ca0 msgr2=0x7f7e581989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e577fe640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e58100ca0 0x7f7e581989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e577fe640 1 -- 172.21.15.100:0/1699732853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5819d440 con 0x7f7e581002f0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e58100ca0 0x7f7e581989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e577fe640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e581002f0 0x7f7e58198490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800e9f0 tx=0x7f7e4800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e557fa640 1 -- 172.21.15.100:0/1699732853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4800cd80 con 0x7f7e581002f0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5819d730 con 0x7f7e581002f0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e557fa640 1 -- 172.21.15.100:0/1699732853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e48005500 con 0x7f7e581002f0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e557fa640 1 -- 172.21.15.100:0/1699732853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48010690 con 0x7f7e581002f0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.528+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e581a5010 con 0x7f7e581002f0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.530+0000 7f7e557fa640 1 -- 172.21.15.100:0/1699732853 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7e480046c0 con 0x7f7e581002f0 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 Processor -- start 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 -- start start 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f55090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f55a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f62760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e557fa640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7e440a2b80 0x7f7e440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563747ebb2f0 con 0x563747f56b40 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563747e62cf0 con 0x563747f555d0 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e60206740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563747eb72b0 con 0x563747f60370 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f55090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f55a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f55090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50730/0 (socket says 172.21.15.100:50730) 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e57fff640 1 -- 172.21.15.100:0/2616761067 learned_addr learned my addr 172.21.15.100:0/2616761067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.531+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f62760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e557fa640 1 -- 172.21.15.100:0/1699732853 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7e480cf470 con 0x7f7e581002f0 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e57fff640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7e440a2b80 0x7f7e440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4ffff640 1 -- 172.21.15.100:0/2616761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 msgr2=0x563747f55a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f55a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4ffff640 1 -- 172.21.15.100:0/2616761067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 msgr2=0x563747f55090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f55090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4ffff640 1 -- 172.21.15.100:0/2616761067 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563747e473a0 con 0x563747f60370 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e577fe640 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e57fff640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7e440a2b80 0x7f7e440a5040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009a60 tx=0x7f7e50032fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f62760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e5806a100 tx=0x7f7e40011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42841150cf0a7d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4dffb640 1 -- 172.21.15.100:0/2616761067 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40004220 con 0x563747f60370 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4dffb640 1 -- 172.21.15.100:0/2616761067 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e400043c0 con 0x563747f60370 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.532+0000 7f7e4dffb640 1 -- 172.21.15.100:0/2616761067 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400035f0 con 0x563747f60370 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 -- 172.21.15.100:0/2616761067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 msgr2=0x563747f62760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f62760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e5806a100 tx=0x7f7e40011810 comp rx=0 tx=0).stop 2024-09-12T02:08:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 -- 172.21.15.100:0/2616761067 shutdown_connections 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f62760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 --2- 172.21.15.100:0/2616761067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f55090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 -- 172.21.15.100:0/2616761067 >> 172.21.15.100:0/2616761067 conn(0x563747f1e310 msgr2=0x563747f51c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 -- 172.21.15.100:0/2616761067 shutdown_connections 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.533+0000 7f7e60206740 1 -- 172.21.15.100:0/2616761067 wait complete. 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 -- start start 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 Processor -- start 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f555d0 0x563747f5fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f5cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f60370 0x563747f5d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563747f63070 con 0x563747f555d0 2024-09-12T02:08:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563747e76060 con 0x563747f60370 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563747f631f0 con 0x563747f56b40 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e60206740 10 client.0 _ll_register_callbacks cb 0x563747bc98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.534+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f555d0 0x563747f5fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f555d0 0x563747f5fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50746/0 (socket says 172.21.15.100:50746) 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e4ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f5cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e577fe640 1 -- 172.21.15.100:0/3348956552 learned_addr learned my addr 172.21.15.100:0/3348956552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e57fff640 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f60370 0x563747f5d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e4ffff640 1 -- 172.21.15.100:0/3348956552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f60370 msgr2=0x563747f5d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f60370 0x563747f5d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e4ffff640 1 -- 172.21.15.100:0/3348956552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f555d0 msgr2=0x563747f5fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f555d0 0x563747f5fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e4ffff640 1 -- 172.21.15.100:0/3348956552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563747c2c3c0 con 0x563747f56b40 2024-09-12T02:08:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e577fe640 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f555d0 0x563747f5fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f5cfb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e40011d10 tx=0x7f7e4000fbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6995770e0153438 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e36ffd640 1 -- 172.21.15.100:0/3348956552 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40027030 con 0x563747f56b40 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e36ffd640 1 -- 172.21.15.100:0/3348956552 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7e4000fdd0 con 0x563747f56b40 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e400043c0 con 0x563747f56b40 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e36ffd640 1 -- 172.21.15.100:0/3348956552 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e4001d040 con 0x563747f56b40 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e60206740 10 client.25072 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.535+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563747f72eb0 con 0x563747f56b40 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e36ffd640 1 -- 172.21.15.100:0/3348956552 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e400043c0 con 0x563747f56b40 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e36ffd640 1 -- 172.21.15.100:0/3348956552 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7e4002e4c0 con 0x563747f56b40 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e60206740 10 client.25072 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e60206740 10 client.25072 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:08:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e60206740 20 client.25072 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e60206740 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747f74200 0x563747f765f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e60206740 4 client.25072 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563747ec8860 con 0x563747f74200 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e577fe640 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747f74200 0x563747f765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e577fe640 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747f74200 0x563747f765f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9695f0ea41d44c7 server_cookie=27834df51cd993a6 in_seq=0 out_seq=0 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.536+0000 7f7e36ffd640 10 client.25072 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e36ffd640 1 -- 172.21.15.100:0/3348956552 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563747ec8860 con 0x563747f74200 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e36ffd640 10 client.25072 handle_command_reply: tid=0 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 client.25072 shutdown 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 msgr2=0x563747f5cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f5cfb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e40011d10 tx=0x7f7e4000fbe0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 shutdown_connections 2024-09-12T02:08:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f60370 0x563747f5d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747f74200 0x563747f765f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f5cfb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 --2- 172.21.15.100:0/3348956552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f555d0 0x563747f5fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e36ffd640 0 client.25072 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 >> 172.21.15.100:0/3348956552 conn(0x563747f1e310 msgr2=0x563747f57930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 shutdown_connections 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.537+0000 7f7e60206740 1 -- 172.21.15.100:0/3348956552 wait complete. 2024-09-12T02:08:21.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.538+0000 7f7e60206740 20 client.25072 trim_cache size 0 max 16384 2024-09-12T02:08:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 Processor -- start 2024-09-12T02:08:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 -- start start 2024-09-12T02:08:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f58720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f7bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581adc60 con 0x563747f56b40 2024-09-12T02:08:21.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581ab530 con 0x563747f555d0 2024-09-12T02:08:21.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e60206740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581a93a0 con 0x563747f60370 2024-09-12T02:08:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.551+0000 7f7e4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f58720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f58720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50748/0 (socket says 172.21.15.100:50748) 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e4ffff640 1 -- 172.21.15.100:0/766413647 learned_addr learned my addr 172.21.15.100:0/766413647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e577fe640 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e57fff640 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f7bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e577fe640 1 -- 172.21.15.100:0/766413647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 msgr2=0x563747f7bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e577fe640 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f7bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e577fe640 1 -- 172.21.15.100:0/766413647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 msgr2=0x563747f58720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e577fe640 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f58720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e577fe640 1 -- 172.21.15.100:0/766413647 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563747f52960 con 0x563747f555d0 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f58720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e577fe640 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f707a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e480ccf20 tx=0x7f7e48004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddd7b83483a190b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e4d7fa640 1 -- 172.21.15.100:0/766413647 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4809bc80 con 0x563747f555d0 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e4d7fa640 1 -- 172.21.15.100:0/766413647 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e480a0030 con 0x563747f555d0 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.552+0000 7f7e4d7fa640 1 -- 172.21.15.100:0/766413647 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4809b0d0 con 0x563747f555d0 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 -- 172.21.15.100:0/766413647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 msgr2=0x563747f707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f707a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e480ccf20 tx=0x7f7e48004a40 comp rx=0 tx=0).stop 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 -- 172.21.15.100:0/766413647 shutdown_connections 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f60370 0x563747f7bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f56b40 0x563747f58720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 --2- 172.21.15.100:0/766413647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f707a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 -- 172.21.15.100:0/766413647 >> 172.21.15.100:0/766413647 conn(0x563747f1e310 msgr2=0x563747f5f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 -- 172.21.15.100:0/766413647 shutdown_connections 2024-09-12T02:08:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.553+0000 7f7e60206740 1 -- 172.21.15.100:0/766413647 wait complete. 2024-09-12T02:08:21.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 -- start start 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 Processor -- start 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f6d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f68530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f60370 0x563747f68c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581a99f0 con 0x563747f60370 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581aae60 con 0x563747f555d0 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e60206740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581aa0c0 con 0x563747f56b40 2024-09-12T02:08:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.554+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f60370 0x563747f68c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e60206740 10 client.0 _ll_register_callbacks cb 0x7f7e48005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f60370 0x563747f68c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50758/0 (socket says 172.21.15.100:50758) 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 -- 172.21.15.100:0/257810223 learned_addr learned my addr 172.21.15.100:0/257810223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e4ffff640 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f68530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e577fe640 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f6d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 -- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 msgr2=0x563747f68530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f68530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 -- 172.21.15.100:0/257810223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 msgr2=0x563747f6d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f6d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 -- 172.21.15.100:0/257810223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563747fddd30 con 0x563747f60370 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e57fff640 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f60370 0x563747f68c70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009cd0 tx=0x7f7e5002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ecdf8a8adf3800 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e36ffd640 1 -- 172.21.15.100:0/257810223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5005a060 con 0x563747f60370 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e36ffd640 1 -- 172.21.15.100:0/257810223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7e500305a0 con 0x563747f60370 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e480a0030 con 0x563747f60370 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e36ffd640 1 -- 172.21.15.100:0/257810223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e500307a0 con 0x563747f60370 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e60206740 10 client.15645 fetch_fsmap learned FSMap version 24 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.555+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563747fdeed0 con 0x563747f60370 2024-09-12T02:08:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e36ffd640 1 -- 172.21.15.100:0/257810223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e480a0030 con 0x563747f60370 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e36ffd640 1 -- 172.21.15.100:0/257810223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7e50054070 con 0x563747f60370 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e60206740 10 client.15645 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e60206740 10 client.15645 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e60206740 20 client.15645 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e60206740 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747fdf680 0x563747fe1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e60206740 4 client.15645 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563747ec2d70 con 0x563747fdf680 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.556+0000 7f7e577fe640 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747fdf680 0x563747fe1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e577fe640 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747fdf680 0x563747fe1aa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f54f57ee8315247 server_cookie=f638b12e2f13dee in_seq=0 out_seq=0 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e36ffd640 10 client.15645 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:08:21.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e36ffd640 1 -- 172.21.15.100:0/257810223 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563747ec2d70 con 0x563747fdf680 2024-09-12T02:08:21.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e36ffd640 10 client.15645 handle_command_reply: tid=0 2024-09-12T02:08:21.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 client.15645 shutdown 2024-09-12T02:08:21.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f60370 msgr2=0x563747f68c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f60370 0x563747f68c70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009cd0 tx=0x7f7e5002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 shutdown_connections 2024-09-12T02:08:21.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563747f60370 0x563747f68c70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x563747fdf680 0x563747fe1aa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563747f56b40 0x563747f68530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 --2- 172.21.15.100:0/257810223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563747f555d0 0x563747f6d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 >> 172.21.15.100:0/257810223 conn(0x563747f1e310 msgr2=0x563747f5b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:21.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e36ffd640 0 client.15645 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:08:21.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 shutdown_connections 2024-09-12T02:08:21.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 1 -- 172.21.15.100:0/257810223 wait complete. 2024-09-12T02:08:21.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.557+0000 7f7e60206740 20 client.15645 trim_cache size 0 max 16384 2024-09-12T02:08:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:08:21.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7e440a2b80 msgr2=0x7f7e440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7e440a2b80 0x7f7e440a5040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009a60 tx=0x7f7e50032fd0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e581002f0 msgr2=0x7f7e58198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:21.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e581002f0 0x7f7e58198490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800e9f0 tx=0x7f7e4800edf0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 shutdown_connections 2024-09-12T02:08:21.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7e440a2b80 0x7f7e440a5040 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e58106f50 0x7f7e5819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e58100ca0 0x7f7e581989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 --2- 172.21.15.100:0/1699732853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e581002f0 0x7f7e58198490 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:21.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 >> 172.21.15.100:0/1699732853 conn(0x7f7e58077210 msgr2=0x7f7e58105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:21.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 shutdown_connections 2024-09-12T02:08:21.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:21.558+0000 7f7e5de2d640 1 -- 172.21.15.100:0/1699732853 wait complete. 2024-09-12T02:08:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-12T02:08:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-12T02:08:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-12T02:08:21.570 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:21.571 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:21.572 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-12T02:08:21.573 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:21.574 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:21.575 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:21.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:21 smithi189 ceph-mon[35188]: pgmap v371: 97 pgs: 97 active+clean; 85 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 1.7 MiB/s wr, 3.71k op/s 2024-09-12T02:08:21.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:21 smithi117 ceph-mon[35240]: pgmap v371: 97 pgs: 97 active+clean; 85 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 1.7 MiB/s wr, 3.71k op/s 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:22.282 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:22.284 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-12T02:08:22.285 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:22.286 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:22.288 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-12T02:08:22.382 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:08:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:22.684 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:22.684 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:22.684 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:22.684 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:22.685 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:22.686 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-12T02:08:22.687 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:22.688 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:22.689 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:22.690 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:23.147 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:23.147 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-12T02:08:23.147 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:23.147 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:23.148 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-12T02:08:23.149 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-12T02:08:23.151 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:23.152 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-12T02:08:23.153 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1642118035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0106a70 msgr2=0x7f26e0106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1642118035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0106a70 0x7f26e0106e50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009930 tx=0x7f26dc02a420 comp rx=0 tx=0).stop 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1642118035 shutdown_connections 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1642118035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26e0101410 0x7f26e010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1642118035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0100a70 0x7f26e0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1642118035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0106a70 0x7f26e0106e50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1642118035 >> 172.21.15.100:0/1642118035 conn(0x7f26e00fc790 msgr2=0x7f26e00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:23.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1642118035 shutdown_connections 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.173+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1642118035 wait complete. 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 Processor -- start 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 -- start start 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0100a70 0x7f26e0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101410 0x7f26e0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26e0106a70 0x7f26e019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0110e70 con 0x7f26e0100a70 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0110cf0 con 0x7f26e0101410 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e7ef1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0110ff0 con 0x7f26e0106a70 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0100a70 0x7f26e0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0100a70 0x7f26e0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50764/0 (socket says 172.21.15.100:50764) 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e5c8d640 1 -- 172.21.15.100:0/1399373114 learned_addr learned my addr 172.21.15.100:0/1399373114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:23.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e548c640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101410 0x7f26e0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.174+0000 7f26e648e640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26e0106a70 0x7f26e019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e5c8d640 1 -- 172.21.15.100:0/1399373114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26e0106a70 msgr2=0x7f26e019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26e0106a70 0x7f26e019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e5c8d640 1 -- 172.21.15.100:0/1399373114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101410 msgr2=0x7f26e0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101410 0x7f26e0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e5c8d640 1 -- 172.21.15.100:0/1399373114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e019d3f0 con 0x7f26e0100a70 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e548c640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101410 0x7f26e0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0100a70 0x7f26e0198440 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009230 tx=0x7f26dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26d6ffd640 1 -- 172.21.15.100:0/1399373114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc03f030 con 0x7f26e0100a70 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26d6ffd640 1 -- 172.21.15.100:0/1399373114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26dc003ad0 con 0x7f26e0100a70 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e019d680 con 0x7f26e0100a70 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26d6ffd640 1 -- 172.21.15.100:0/1399373114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc035070 con 0x7f26e0100a70 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.175+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01a4fc0 con 0x7f26e0100a70 2024-09-12T02:08:23.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.177+0000 7f26d6ffd640 1 -- 172.21.15.100:0/1399373114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f26dc042030 con 0x7f26e0100a70 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 Processor -- start 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 -- start start 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560962710b40 0x56096270f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56096271e780 0x560962720b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5609626752f0 con 0x560962710b40 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56096261ccf0 con 0x56096270f5d0 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609626712b0 con 0x56096271e780 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26e648e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560962710b40 0x56096270f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26e648e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560962710b40 0x56096270f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50780/0 (socket says 172.21.15.100:50780) 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.178+0000 7f26e648e640 1 -- 172.21.15.100:0/1914768082 learned_addr learned my addr 172.21.15.100:0/1914768082 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e548c640 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56096271e780 0x560962720b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26d6ffd640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26cc0a2b80 0x7f26cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e648e640 1 -- 172.21.15.100:0/1914768082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56096271e780 msgr2=0x560962720b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e648e640 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56096271e780 0x560962720b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e648e640 1 -- 172.21.15.100:0/1914768082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 msgr2=0x56096270fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e648e640 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e648e640 1 -- 172.21.15.100:0/1914768082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609626013a0 con 0x560962710b40 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e548c640 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56096271e780 0x560962720b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26d6ffd640 1 -- 172.21.15.100:0/1399373114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f26dc0ef600 con 0x7f26e0100a70 2024-09-12T02:08:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e648e640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26cc0a2b80 0x7f26cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26e648e640 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560962710b40 0x56096270f090 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009f70 tx=0x7f26d8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ceb5d34ecbcc84a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26cbfff640 1 -- 172.21.15.100:0/1914768082 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8016070 con 0x560962710b40 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26cbfff640 1 -- 172.21.15.100:0/1914768082 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d801c440 con 0x560962710b40 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.179+0000 7f26cbfff640 1 -- 172.21.15.100:0/1914768082 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d801b6e0 con 0x560962710b40 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 -- 172.21.15.100:0/1914768082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560962710b40 msgr2=0x56096270f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560962710b40 0x56096270f090 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009f70 tx=0x7f26d8010800 comp rx=0 tx=0).stop 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26e648e640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26cc0a2b80 0x7f26cc0a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26d8011010 tx=0x7f26d801bd10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 -- 172.21.15.100:0/1914768082 shutdown_connections 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56096271e780 0x560962720b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/1914768082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560962710b40 0x56096270f090 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 -- 172.21.15.100:0/1914768082 >> 172.21.15.100:0/1914768082 conn(0x5609626d8310 msgr2=0x56096270bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 -- 172.21.15.100:0/1914768082 shutdown_connections 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.180+0000 7f26ea2ca740 1 -- 172.21.15.100:0/1914768082 wait complete. 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 -- start start 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 Processor -- start 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x56096271e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096271b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x56096271b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560962721480 con 0x56096270f5d0 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560962630060 con 0x56096271e780 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560962721600 con 0x560962710b40 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26ea2ca740 10 client.0 _ll_register_callbacks cb 0x5609623838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x56096271e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x56096271e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50792/0 (socket says 172.21.15.100:50792) 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.181+0000 7f26e5c8d640 1 -- 172.21.15.100:0/3710696925 learned_addr learned my addr 172.21.15.100:0/3710696925 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e548c640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096271b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e648e640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x56096271b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e5c8d640 1 -- 172.21.15.100:0/3710696925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 msgr2=0x56096271b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096271b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e5c8d640 1 -- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 msgr2=0x56096271b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x56096271b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e5c8d640 1 -- 172.21.15.100:0/3710696925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609623e63c0 con 0x56096270f5d0 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e548c640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096271b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x56096271e150 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0f2de0 tx=0x7f26dc02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60118a593edf3383 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26c97fa640 1 -- 172.21.15.100:0/3710696925 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc049070 con 0x56096270f5d0 2024-09-12T02:08:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26c97fa640 1 -- 172.21.15.100:0/3710696925 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f26dc0b8530 con 0x56096270f5d0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26d801c440 con 0x56096270f5d0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26c97fa640 1 -- 172.21.15.100:0/3710696925 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f26dc0bb820 con 0x56096270f5d0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26ea2ca740 10 client.15657 fetch_fsmap learned FSMap version 25 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.182+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56096272cef0 con 0x56096270f5d0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26c97fa640 1 -- 172.21.15.100:0/3710696925 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d801c440 con 0x56096270f5d0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26c97fa640 1 -- 172.21.15.100:0/3710696925 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f26dc003c80 con 0x56096270f5d0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26ea2ca740 10 client.15657 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26ea2ca740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26ea2ca740 20 client.15657 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56096272e3a0 0x560962730820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26ea2ca740 4 client.15657 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560962682860 con 0x56096272e3a0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26e548c640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56096272e3a0 0x560962730820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26e548c640 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56096272e3a0 0x560962730820 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ef5ddab6381898b server_cookie=edb9d295ce7d6758 in_seq=0 out_seq=0 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.183+0000 7f26c97fa640 10 client.15657 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.184+0000 7f26c97fa640 1 -- 172.21.15.100:0/3710696925 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560962682860 con 0x56096272e3a0 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26c97fa640 10 client.15657 handle_command_reply: tid=0 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 client.15657 shutdown 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 msgr2=0x56096271e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x56096271e150 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0f2de0 tx=0x7f26dc02a420 comp rx=0 tx=0).stop 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 shutdown_connections 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56096272e3a0 0x560962730820 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x56096271b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26c97fa640 0 client.15657 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096271b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/3710696925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x56096271e150 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 >> 172.21.15.100:0/3710696925 conn(0x5609626d8310 msgr2=0x560962711930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:23.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 shutdown_connections 2024-09-12T02:08:23.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 1 -- 172.21.15.100:0/3710696925 wait complete. 2024-09-12T02:08:23.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.185+0000 7f26ea2ca740 20 client.15657 trim_cache size 0 max 16384 2024-09-12T02:08:23.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 Processor -- start 2024-09-12T02:08:23.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 -- start start 2024-09-12T02:08:23.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096272a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096271e780 0x56096271acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01adb30 con 0x56096271e780 2024-09-12T02:08:23.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01ab400 con 0x56096270f5d0 2024-09-12T02:08:23.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01a9250 con 0x560962710b40 2024-09-12T02:08:23.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26e648e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096271e780 0x56096271acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26e648e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096271e780 0x56096271acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50796/0 (socket says 172.21.15.100:50796) 2024-09-12T02:08:23.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:47514/0 (socket says 172.21.15.100:47514) 2024-09-12T02:08:23.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.199+0000 7f26e648e640 1 -- 172.21.15.100:0/2729635344 learned_addr learned my addr 172.21.15.100:0/2729635344 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26e648e640 1 -- 172.21.15.100:0/2729635344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 msgr2=0x56096272a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26e648e640 1 --2- 172.21.15.100:0/2729635344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096272a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26e648e640 1 -- 172.21.15.100:0/2729635344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 msgr2=0x56096270be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26e648e640 1 --2- 172.21.15.100:0/2729635344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26e648e640 1 -- 172.21.15.100:0/2729635344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560962716fd0 con 0x56096271e780 2024-09-12T02:08:23.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26e648e640 1 --2- 172.21.15.100:0/2729635344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096271e780 0x56096271acc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f26d8010e70 tx=0x7f26d8027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26227abaaaff46c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:23.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26cb7fe640 1 -- 172.21.15.100:0/2729635344 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8036070 con 0x56096271e780 2024-09-12T02:08:23.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26cb7fe640 1 -- 172.21.15.100:0/2729635344 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d8009b90 con 0x56096271e780 2024-09-12T02:08:23.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.200+0000 7f26cb7fe640 1 -- 172.21.15.100:0/2729635344 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d802d040 con 0x56096271e780 2024-09-12T02:08:23.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 -- 172.21.15.100:0/2729635344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096271e780 msgr2=0x56096271acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/2729635344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096271e780 0x56096271acc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f26d8010e70 tx=0x7f26d8027000 comp rx=0 tx=0).stop 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 -- 172.21.15.100:0/2729635344 shutdown_connections 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/2729635344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096271e780 0x56096271acc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/2729635344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x56096272a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/2729635344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096270f5d0 0x56096270be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 -- 172.21.15.100:0/2729635344 >> 172.21.15.100:0/2729635344 conn(0x5609626d8310 msgr2=0x56096270b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 -- 172.21.15.100:0/2729635344 shutdown_connections 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 -- 172.21.15.100:0/2729635344 wait complete. 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 -- start start 2024-09-12T02:08:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.202+0000 7f26ea2ca740 1 Processor -- start 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x5609627271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x5609627224e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26ea2ca740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x560962722c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01a98c0 con 0x56096270f5d0 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01aad30 con 0x56096271e780 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26ea2ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01a9f90 con 0x560962710b40 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26ea2ca740 10 client.0 _ll_register_callbacks cb 0x7f26dc0f2d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x5609627271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e5c8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x5609627271b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50814/0 (socket says 172.21.15.100:50814) 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e5c8d640 1 -- 172.21.15.100:0/4294099398 learned_addr learned my addr 172.21.15.100:0/4294099398 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e648e640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x560962722c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e548c640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x5609627224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e648e640 1 -- 172.21.15.100:0/4294099398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 msgr2=0x5609627224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e648e640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x5609627224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e648e640 1 -- 172.21.15.100:0/4294099398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 msgr2=0x5609627271b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e648e640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x5609627271b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e648e640 1 -- 172.21.15.100:0/4294099398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560962798100 con 0x56096271e780 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.203+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x5609627271b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26e648e640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x560962722c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26d8034040 tx=0x7f26d801bfc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1cca289fc5753a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26c97fa640 1 -- 172.21.15.100:0/4294099398 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8036070 con 0x56096271e780 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26c97fa640 1 -- 172.21.15.100:0/4294099398 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f26d8003a70 con 0x56096271e780 2024-09-12T02:08:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26d8009b90 con 0x56096271e780 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26c97fa640 1 -- 172.21.15.100:0/4294099398 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f26d8016040 con 0x56096271e780 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 10 client.25172 fetch_fsmap learned FSMap version 25 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5609627992e0 con 0x56096271e780 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26c97fa640 1 -- 172.21.15.100:0/4294099398 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d8009b90 con 0x56096271e780 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26c97fa640 1 -- 172.21.15.100:0/4294099398 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f26d8043020 con 0x56096271e780 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 10 client.25172 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 10 client.25172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 20 client.25172 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560962799850 0x56096279bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 4 client.25172 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.204+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56096267cd70 con 0x560962799850 2024-09-12T02:08:23.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560962799850 0x56096279bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26e5c8d640 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560962799850 0x56096279bc40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f01ad026a047a70d server_cookie=2cccfe73d9779ac9 in_seq=0 out_seq=0 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26c97fa640 10 client.25172 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26c97fa640 1 -- 172.21.15.100:0/4294099398 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56096267cd70 con 0x560962799850 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26c97fa640 10 client.25172 handle_command_reply: tid=0 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26ea2ca740 1 client.25172 shutdown 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 msgr2=0x560962722c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.205+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x560962722c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26d8034040 tx=0x7f26d801bfc0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 shutdown_connections 2024-09-12T02:08:23.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x560962799850 0x56096279bc40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56096271e780 0x560962722c70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560962710b40 0x5609627224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 --2- 172.21.15.100:0/4294099398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56096270f5d0 0x5609627271b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26c97fa640 0 client.25172 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 >> 172.21.15.100:0/4294099398 conn(0x5609626d8310 msgr2=0x56096270a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 shutdown_connections 2024-09-12T02:08:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 1 -- 172.21.15.100:0/4294099398 wait complete. 2024-09-12T02:08:23.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26ea2ca740 20 client.25172 trim_cache size 0 max 16384 2024-09-12T02:08:23.214 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26cc0a2b80 msgr2=0x7f26cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26cc0a2b80 0x7f26cc0a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26d8011010 tx=0x7f26d801bd10 comp rx=0 tx=0).stop 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0100a70 msgr2=0x7f26e0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.206+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0100a70 0x7f26e0198440 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009230 tx=0x7f26dc004270 comp rx=0 tx=0).stop 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 shutdown_connections 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f26cc0a2b80 0x7f26cc0a5040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26e0106a70 0x7f26e019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101410 0x7f26e0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 --2- 172.21.15.100:0/1399373114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0100a70 0x7f26e0198440 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:23.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 >> 172.21.15.100:0/1399373114 conn(0x7f26e00fc790 msgr2=0x7f26e006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:23.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 shutdown_connections 2024-09-12T02:08:23.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:23.207+0000 7f26e7ef1640 1 -- 172.21.15.100:0/1399373114 wait complete. 2024-09-12T02:08:23.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:23 smithi100 ceph-mon[31179]: pgmap v372: 97 pgs: 97 active+clean; 165 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 415 KiB/s wr, 4.06k op/s 2024-09-12T02:08:23.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:23 smithi100 ceph-mon[31179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:08:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:23 smithi189 ceph-mon[35188]: pgmap v372: 97 pgs: 97 active+clean; 165 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 415 KiB/s wr, 4.06k op/s 2024-09-12T02:08:23.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:23 smithi189 ceph-mon[35188]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:08:23.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:23 smithi117 ceph-mon[35240]: pgmap v372: 97 pgs: 97 active+clean; 165 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 415 KiB/s wr, 4.06k op/s 2024-09-12T02:08:23.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:23 smithi117 ceph-mon[35240]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:08:23.842 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:23.842 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:23.842 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-12T02:08:23.842 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:23.842 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:23.843 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:23.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:23.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:23.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:23.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-12T02:08:23.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:23.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:23.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:23.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-12T02:08:23.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-12T02:08:24.472 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:24.473 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-12T02:08:24.474 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:24.475 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-12T02:08:24.476 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:24.477 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:24.892 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:24.892 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-12T02:08:24.892 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:24.892 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:24.893 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:24.894 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:24.895 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:24.896 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-12T02:08:24.898 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-12T02:08:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:25.113 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:08:25.113 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:08:25.436 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:25.498 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-12T02:08:25.498 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:25.498 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:25.498 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:25.498 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:25.499 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:25.501 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:25.502 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:25.503 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-12T02:08:25.505 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:25.505 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:25.505 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:25.505 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 -- 172.21.15.100:0/3432295541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 msgr2=0x7f4a441011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 --2- 172.21.15.100:0/3432295541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441011b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009900 tx=0x7f4a3002a410 comp rx=0 tx=0).stop 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 -- 172.21.15.100:0/3432295541 shutdown_connections 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 --2- 172.21.15.100:0/3432295541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a441016f0 0x7f4a44108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 --2- 172.21.15.100:0/3432295541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441011b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 --2- 172.21.15.100:0/3432295541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44102000 0x7f4a44102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 -- 172.21.15.100:0/3432295541 >> 172.21.15.100:0/3432295541 conn(0x7f4a440fb970 msgr2=0x7f4a440fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 -- 172.21.15.100:0/3432295541 shutdown_connections 2024-09-12T02:08:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.516+0000 7f4a4af86640 1 -- 172.21.15.100:0/3432295541 wait complete. 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 Processor -- start 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 -- start start 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a441016f0 0x7f4a4419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44102000 0x7f4a4419f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410c6e0 con 0x7f4a44100d30 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410c560 con 0x7f4a441016f0 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a4af86640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410c860 con 0x7f4a44102000 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a48d22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a441016f0 0x7f4a4419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a48d22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59340/0 (socket says 172.21.15.100:59340) 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a48d22640 1 -- 172.21.15.100:0/1223695580 learned_addr learned my addr 172.21.15.100:0/1223695580 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.517+0000 7f4a49523640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44102000 0x7f4a4419f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a48d22640 1 -- 172.21.15.100:0/1223695580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44102000 msgr2=0x7f4a4419f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a48d22640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44102000 0x7f4a4419f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a48d22640 1 -- 172.21.15.100:0/1223695580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a441016f0 msgr2=0x7f4a4419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a48d22640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a441016f0 0x7f4a4419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a48d22640 1 -- 172.21.15.100:0/1223695580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4419f9c0 con 0x7f4a44100d30 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a49523640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44102000 0x7f4a4419f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a48d22640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441007d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800c970 tx=0x7f4a3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a41ffb640 1 -- 172.21.15.100:0/1223695580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38007c10 con 0x7f4a44100d30 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a41ffb640 1 -- 172.21.15.100:0/1223695580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a38007db0 con 0x7f4a44100d30 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a4419fcb0 con 0x7f4a44100d30 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a41ffb640 1 -- 172.21.15.100:0/1223695580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800f940 con 0x7f4a44100d30 2024-09-12T02:08:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.518+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a441a01d0 con 0x7f4a44100d30 2024-09-12T02:08:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.520+0000 7f4a41ffb640 1 -- 172.21.15.100:0/1223695580 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4a3800fae0 con 0x7f4a44100d30 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a4ddf7740 1 Processor -- start 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a4ddf7740 1 -- start start 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a41ffb640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a340a2c30 0x7f4a340a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111c4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ad111202f0 con 0x55ad111bd2e0 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.521+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ad110c8270 con 0x55ad111c2370 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ad1111c2b0 con 0x55ad111bc9a0 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a49523640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a340a2c30 0x7f4a340a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111bcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:42136/0 (socket says 172.21.15.100:42136) 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 -- 172.21.15.100:0/2833239528 learned_addr learned my addr 172.21.15.100:0/2833239528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a41ffb640 1 -- 172.21.15.100:0/1223695580 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a380cf420 con 0x7f4a44100d30 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a43fff640 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a49523640 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 -- 172.21.15.100:0/2833239528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 msgr2=0x55ad111c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 -- 172.21.15.100:0/2833239528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 msgr2=0x55ad111c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 -- 172.21.15.100:0/2833239528 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad110c7340 con 0x55ad111bc9a0 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a49523640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a340a2c30 0x7f4a340a50f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c005fd0 tx=0x7f4a3c0128d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111bcda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a380ccf30 tx=0x7f4a3801df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14b5109ca415489 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a2effd640 1 -- 172.21.15.100:0/2833239528 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3809c420 con 0x55ad111bc9a0 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a2effd640 1 -- 172.21.15.100:0/2833239528 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a3809bd20 con 0x55ad111bc9a0 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.522+0000 7f4a2effd640 1 -- 172.21.15.100:0/2833239528 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38012e10 con 0x55ad111bc9a0 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2833239528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 msgr2=0x55ad111bcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111bcda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a380ccf30 tx=0x7f4a3801df90 comp rx=0 tx=0).stop 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2833239528 shutdown_connections 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2833239528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111bcda0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2833239528 >> 172.21.15.100:0/2833239528 conn(0x55ad111b8010 msgr2=0x55ad111b8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2833239528 shutdown_connections 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.523+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2833239528 wait complete. 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 -- start start 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 Processor -- start 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ad111c5340 con 0x55ad111bd2e0 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ad110a9290 con 0x55ad111c2370 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ad111c54c0 con 0x55ad111bc9a0 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a4ddf7740 10 client.0 _ll_register_callbacks cb 0x55ad110da140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a48d22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59344/0 (socket says 172.21.15.100:59344) 2024-09-12T02:08:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 -- 172.21.15.100:0/307794331 learned_addr learned my addr 172.21.15.100:0/307794331 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a49523640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 -- 172.21.15.100:0/307794331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 msgr2=0x55ad111c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 -- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 msgr2=0x55ad111ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a43fff640 1 -- 172.21.15.100:0/307794331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad10e33210 con 0x55ad111bd2e0 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a48d22640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.524+0000 7f4a49523640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a43fff640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c70e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009900 tx=0x7f4a30031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc0595e87579e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a23fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a23fff640 1 -- 172.21.15.100:0/307794331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30035040 con 0x55ad111bd2e0 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a23fff640 1 -- 172.21.15.100:0/307794331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a30004040 con 0x55ad111bd2e0 2024-09-12T02:08:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a3809bd20 con 0x55ad111bd2e0 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a23fff640 1 -- 172.21.15.100:0/307794331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4a30004240 con 0x55ad111bd2e0 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 10 client.15675 fetch_fsmap learned FSMap version 25 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad10eff620 con 0x55ad111bd2e0 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a23fff640 1 -- 172.21.15.100:0/307794331 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a3809bd20 con 0x55ad111bd2e0 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a23fff640 1 -- 172.21.15.100:0/307794331 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f4a30046580 con 0x55ad111bd2e0 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 10 client.15675 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 20 client.15675 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad111d2810 0x55ad111d4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 4 client.15675 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.525+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad1112da20 con 0x55ad111d2810 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.526+0000 7f4a48d22640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad111d2810 0x55ad111d4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.526+0000 7f4a23fff640 10 client.15675 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.526+0000 7f4a48d22640 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad111d2810 0x55ad111d4c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3310eccb6c114d01 server_cookie=dc37559178cba2ef in_seq=0 out_seq=0 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.526+0000 7f4a23fff640 1 -- 172.21.15.100:0/307794331 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad1112da20 con 0x55ad111d2810 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.526+0000 7f4a23fff640 10 client.15675 handle_command_reply: tid=0 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.526+0000 7f4a4ddf7740 1 client.15675 shutdown 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 msgr2=0x55ad111c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c70e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009900 tx=0x7f4a30031f50 comp rx=0 tx=0).stop 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 shutdown_connections 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad111d2810 0x55ad111d4c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111c2370 0x55ad111ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a23fff640 0 client.15675 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111c70e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/307794331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111bc9a0 0x55ad111c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 >> 172.21.15.100:0/307794331 conn(0x55ad111b8010 msgr2=0x55ad111b9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 shutdown_connections 2024-09-12T02:08:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/307794331 wait complete. 2024-09-12T02:08:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.527+0000 7f4a4ddf7740 20 client.15675 trim_cache size 0 max 16384 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 Processor -- start 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 -- start start 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad111b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111d9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 0x55ad111d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441ab780 con 0x55ad111bd2e0 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441a9050 con 0x55ad111bc9a0 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441a6ea0 con 0x55ad111c2370 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad111b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad111b70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48962/0 (socket says 172.21.15.100:48962) 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 -- 172.21.15.100:0/2290474274 learned_addr learned my addr 172.21.15.100:0/2290474274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 -- 172.21.15.100:0/2290474274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 msgr2=0x55ad111d9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2290474274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 0x55ad111d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 -- 172.21.15.100:0/2290474274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 msgr2=0x55ad111d9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2290474274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111d9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.542+0000 7f4a48d22640 1 -- 172.21.15.100:0/2290474274 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad111bd7c0 con 0x55ad111bc9a0 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.543+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2290474274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad111b70b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4a3809bc60 tx=0x7f4a380cf040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d894a43aab2a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.543+0000 7f4a2e7fc640 1 -- 172.21.15.100:0/2290474274 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3809c420 con 0x55ad111bc9a0 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.543+0000 7f4a2e7fc640 1 -- 172.21.15.100:0/2290474274 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a380a4900 con 0x55ad111bc9a0 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.543+0000 7f4a2e7fc640 1 -- 172.21.15.100:0/2290474274 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38018b80 con 0x55ad111bc9a0 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2290474274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 msgr2=0x55ad111b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2290474274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad111b70b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4a3809bc60 tx=0x7f4a380cf040 comp rx=0 tx=0).stop 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2290474274 shutdown_connections 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2290474274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 0x55ad111d9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2290474274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad111d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2290474274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad111b70b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2290474274 >> 172.21.15.100:0/2290474274 conn(0x55ad111b8010 msgr2=0x55ad111b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2290474274 shutdown_connections 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2290474274 wait complete. 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 -- start start 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 Processor -- start 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad11238400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad11238940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.544+0000 7f4a4ddf7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 0x55ad1123f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441a7510 con 0x55ad111bd2e0 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441a8980 con 0x55ad111bc9a0 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a4ddf7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441a7be0 con 0x55ad111c2370 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a4ddf7740 10 client.0 _ll_register_callbacks cb 0x7f4a30031be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad11238940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad11238940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59368/0 (socket says 172.21.15.100:59368) 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 -- 172.21.15.100:0/2591433612 learned_addr learned my addr 172.21.15.100:0/2591433612 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a49523640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 0x55ad1123f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad11238400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 -- 172.21.15.100:0/2591433612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 msgr2=0x55ad1123f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 0x55ad1123f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 -- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 msgr2=0x55ad11238400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad11238400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 -- 172.21.15.100:0/2591433612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad1123ff90 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad11238400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a43fff640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad11238940 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4a3002a930 tx=0x7f4a30004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ef541b0d397237 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a23fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a23fff640 1 -- 172.21.15.100:0/2591433612 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30035040 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a23fff640 1 -- 172.21.15.100:0/2591433612 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a30046480 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a380a4900 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a23fff640 1 -- 172.21.15.100:0/2591433612 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4a30046680 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a4ddf7740 10 client.15681 fetch_fsmap learned FSMap version 25 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.545+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad11241310 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a23fff640 1 -- 172.21.15.100:0/2591433612 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a380a4900 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a23fff640 1 -- 172.21.15.100:0/2591433612 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f4a30005020 con 0x55ad111bd2e0 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a4ddf7740 10 client.15681 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:08:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a4ddf7740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a4ddf7740 20 client.15681 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad11241d20 0x55ad11244140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a4ddf7740 4 client.15681 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:08:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad11127d70 con 0x55ad11241d20 2024-09-12T02:08:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad11241d20 0x55ad11244140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a48d22640 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad11241d20 0x55ad11244140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2b2d8702c77ab75 server_cookie=dd63ab39ff71a058 in_seq=0 out_seq=0 2024-09-12T02:08:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.546+0000 7f4a23fff640 10 client.15681 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:25.559 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:25 smithi100 ceph-mon[31179]: pgmap v373: 97 pgs: 97 active+clean; 175 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 959 KiB/s wr, 2.54k op/s 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a23fff640 1 -- 172.21.15.100:0/2591433612 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad11127d70 con 0x55ad11241d20 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a23fff640 10 client.15681 handle_command_reply: tid=0 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 client.15681 shutdown 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 msgr2=0x55ad11238940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad11238940 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4a3002a930 tx=0x7f4a30004610 comp rx=0 tx=0).stop 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 shutdown_connections 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x55ad11241d20 0x55ad11244140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad111c2370 0x55ad1123f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad111bd2e0 0x55ad11238940 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 --2- 172.21.15.100:0/2591433612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ad111bc9a0 0x55ad11238400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a23fff640 0 client.15681 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.560+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 >> 172.21.15.100:0/2591433612 conn(0x55ad111b8010 msgr2=0x55ad111b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 shutdown_connections 2024-09-12T02:08:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4ddf7740 1 -- 172.21.15.100:0/2591433612 wait complete. 2024-09-12T02:08:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4ddf7740 20 client.15681 trim_cache size 0 max 16384 2024-09-12T02:08:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-09-12T02:08:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-09-12T02:08:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-09-12T02:08:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-09-12T02:08:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a340a2c30 msgr2=0x7f4a340a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a340a2c30 0x7f4a340a50f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c005fd0 tx=0x7f4a3c0128d0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 msgr2=0x7f4a441007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441007d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800c970 tx=0x7f4a3800ce30 comp rx=0 tx=0).stop 2024-09-12T02:08:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 shutdown_connections 2024-09-12T02:08:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a340a2c30 0x7f4a340a50f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a44102000 0x7f4a4419f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a441016f0 0x7f4a4419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 --2- 172.21.15.100:0/1223695580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44100d30 0x7f4a441007d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 >> 172.21.15.100:0/1223695580 conn(0x7f4a440fb970 msgr2=0x7f4a44105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 shutdown_connections 2024-09-12T02:08:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-09-12T02:08:25.561+0000 7f4a4af86640 1 -- 172.21.15.100:0/1223695580 wait complete. 2024-09-12T02:08:25.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:25 smithi189 ceph-mon[35188]: pgmap v373: 97 pgs: 97 active+clean; 175 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 959 KiB/s wr, 2.54k op/s 2024-09-12T02:08:25.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:25 smithi117 ceph-mon[35240]: pgmap v373: 97 pgs: 97 active+clean; 175 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 MiB/s rd, 959 KiB/s wr, 2.54k op/s 2024-09-12T02:08:26.210 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:26.210 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:26.210 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:26.210 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-12T02:08:26.211 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:26.212 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:26.213 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-12T02:08:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:26.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-12T02:08:26.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:26.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:26.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:26.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:26.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:26.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:26.717 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-12T02:08:26.719 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-12T02:08:26.721 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:27.115 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-12T02:08:27.117 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:27.118 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:27.119 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:27.120 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-12T02:08:27.121 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:27.121 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:27.121 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:27.121 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-12T02:08:27.121 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:27.121 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:27.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:27 smithi100 ceph-mon[31179]: pgmap v374: 97 pgs: 97 active+clean; 212 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 1.0 MiB/s wr, 2.60k op/s 2024-09-12T02:08:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:27 smithi100 ceph-mon[31179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:08:27.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:27 smithi189 ceph-mon[35188]: pgmap v374: 97 pgs: 97 active+clean; 212 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 1.0 MiB/s wr, 2.60k op/s 2024-09-12T02:08:27.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:27 smithi189 ceph-mon[35188]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:08:27.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:27 smithi117 ceph-mon[35240]: pgmap v374: 97 pgs: 97 active+clean; 212 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 1.0 MiB/s wr, 2.60k op/s 2024-09-12T02:08:27.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:27 smithi117 ceph-mon[35240]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:08:27.670 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:27.670 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:27.674 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-12T02:08:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 -- 172.21.15.100:0/1713681089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c3410c180 msgr2=0x7f4c3410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 --2- 172.21.15.100:0/1713681089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c3410c180 0x7f4c3410e610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009be0 tx=0x7f4c2c02a750 comp rx=0 tx=0).stop 2024-09-12T02:08:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 -- 172.21.15.100:0/1713681089 shutdown_connections 2024-09-12T02:08:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 --2- 172.21.15.100:0/1713681089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c3410c180 0x7f4c3410e610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 --2- 172.21.15.100:0/1713681089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c34103700 0x7f4c3410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 --2- 172.21.15.100:0/1713681089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c34102de0 0x7f4c341031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 -- 172.21.15.100:0/1713681089 >> 172.21.15.100:0/1713681089 conn(0x7f4c340fc7a0 msgr2=0x7f4c340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 -- 172.21.15.100:0/1713681089 shutdown_connections 2024-09-12T02:08:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 -- 172.21.15.100:0/1713681089 wait complete. 2024-09-12T02:08:27.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.926+0000 7f4c39140640 1 Processor -- start 2024-09-12T02:08:27.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c39140640 1 -- start start 2024-09-12T02:08:27.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c39140640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c34102de0 0x7f4c34100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c39140640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c34103700 0x7f4c34100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c39140640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c3410c180 0x7f4c341014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c39140640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c34111f20 con 0x7f4c3410c180 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c39140640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4c34111da0 con 0x7f4c34102de0 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c39140640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341120a0 con 0x7f4c34103700 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c34102de0 0x7f4c34100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c3359e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c3410c180 0x7f4c341014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c34102de0 0x7f4c34100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:48990/0 (socket says 172.21.15.100:48990) 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 -- 172.21.15.100:0/1749997105 learned_addr learned my addr 172.21.15.100:0/1749997105 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c34103700 0x7f4c34100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 -- 172.21.15.100:0/1749997105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c34103700 msgr2=0x7f4c34100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c34103700 0x7f4c34100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 -- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c3410c180 msgr2=0x7f4c341014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c3410c180 0x7f4c341014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c32d9d640 1 -- 172.21.15.100:0/1749997105 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c341a6940 con 0x7f4c34102de0 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c34103700 0x7f4c34100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.927+0000 7f4c3359e640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c3410c180 0x7f4c341014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.928+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c34102de0 0x7f4c34100a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400e9f0 tx=0x7f4c2400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.928+0000 7f4c30d99640 1 -- 172.21.15.100:0/1749997105 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400cd80 con 0x7f4c34102de0 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.928+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c341a6c30 con 0x7f4c34102de0 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.928+0000 7f4c30d99640 1 -- 172.21.15.100:0/1749997105 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c24010910 con 0x7f4c34102de0 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.928+0000 7f4c30d99640 1 -- 172.21.15.100:0/1749997105 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c240188f0 con 0x7f4c34102de0 2024-09-12T02:08:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.928+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c341a71c0 con 0x7f4c34102de0 2024-09-12T02:08:27.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.930+0000 7f4c3b519740 1 Processor -- start 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.930+0000 7f4c3b519740 1 -- start start 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cc4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44cd2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c3b519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f44c2a280 con 0x555f44cc5480 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c3b519740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555f44bd1b10 con 0x555f44cc4b60 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c3b519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555f44c26240 con 0x555f44ccfd40 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c30d99640 1 -- 172.21.15.100:0/1749997105 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4c24010ac0 con 0x7f4c34102de0 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44cd2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44cd2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:42208/0 (socket says 172.21.15.100:42208) 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 -- 172.21.15.100:0/1008664641 learned_addr learned my addr 172.21.15.100:0/1008664641 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c3359e640 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cc4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 -- 172.21.15.100:0/1008664641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 msgr2=0x555f44cc4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cc4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 -- 172.21.15.100:0/1008664641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 msgr2=0x555f44ccf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c2a59c640 1 -- 172.21.15.100:0/1008664641 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f44bde1f0 con 0x555f44ccfd40 2024-09-12T02:08:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.931+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:08:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.932+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44cd2130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009cc0 tx=0x7f4c1c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=562418fddf3a9261 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.932+0000 7f4c2959a640 1 -- 172.21.15.100:0/1008664641 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c01c480 con 0x555f44ccfd40 2024-09-12T02:08:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.932+0000 7f4c2959a640 1 -- 172.21.15.100:0/1008664641 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c1c01cb00 con 0x555f44ccfd40 2024-09-12T02:08:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.932+0000 7f4c2959a640 1 -- 172.21.15.100:0/1008664641 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c011ce0 con 0x555f44ccfd40 2024-09-12T02:08:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.932+0000 7f4c30d99640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4c200a2b80 0x7f4c200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3359e640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4c200a2b80 0x7f4c200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c30d99640 1 -- 172.21.15.100:0/1749997105 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4c240cf4c0 con 0x7f4c34102de0 2024-09-12T02:08:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 -- 172.21.15.100:0/1008664641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 msgr2=0x555f44cd2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44cd2130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009cc0 tx=0x7f4c1c0107a0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 -- 172.21.15.100:0/1008664641 shutdown_connections 2024-09-12T02:08:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44cd2130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 --2- 172.21.15.100:0/1008664641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cc4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 -- 172.21.15.100:0/1008664641 >> 172.21.15.100:0/1008664641 conn(0x555f44cc10f0 msgr2=0x555f44cc14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 -- 172.21.15.100:0/1008664641 shutdown_connections 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3359e640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4c200a2b80 0x7f4c200a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0099a0 tx=0x7f4c2c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.933+0000 7f4c3b519740 1 -- 172.21.15.100:0/1008664641 wait complete. 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 -- start start 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 Processor -- start 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44ccd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f44cd2910 con 0x555f44cc5480 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555f44be4f10 con 0x555f44cc4b60 2024-09-12T02:08:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555f44cd2a90 con 0x555f44ccfd40 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3b519740 10 client.0 _ll_register_callbacks cb 0x555f44bada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.934+0000 7f4c3359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44ccd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c32d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c3359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44ccd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:42210/0 (socket says 172.21.15.100:42210) 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c3359e640 1 -- 172.21.15.100:0/2820478007 learned_addr learned my addr 172.21.15.100:0/2820478007 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c32d9d640 1 -- 172.21.15.100:0/2820478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 msgr2=0x555f44ccd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44ccd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c32d9d640 1 -- 172.21.15.100:0/2820478007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 msgr2=0x555f44ccd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c32d9d640 1 -- 172.21.15.100:0/2820478007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4499b6a0 con 0x555f44cc4b60 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c3359e640 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44ccd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cccbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c240cd020 tx=0x7f4c2409c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b260407ad0d458b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/2820478007 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c240cf270 con 0x555f44cc4b60 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/2820478007 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4c240d2b50 con 0x555f44cc4b60 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c01cb00 con 0x555f44cc4b60 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.935+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/2820478007 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c240d2d50 con 0x555f44cc4b60 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 10 client.25199 fetch_fsmap learned FSMap version 26 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555f44cde430 con 0x555f44cc4b60 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/2820478007 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c1c01cb00 con 0x555f44cc4b60 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/2820478007 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4c24097c10 con 0x555f44cc4b60 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 10 client.25199 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 10 client.25199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 20 client.25199 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44cdf8f0 0x555f44ce1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 4 client.25199 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f44c377f0 con 0x555f44cdf8f0 2024-09-12T02:08:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.936+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44cdf8f0 0x555f44ce1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.937+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44cdf8f0 0x555f44ce1d40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc3755eff91e76b server_cookie=f1bab81c6c3397d4 in_seq=0 out_seq=0 2024-09-12T02:08:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.937+0000 7f4c1a7fc640 10 client.25199 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.937+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/2820478007 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f44c377f0 con 0x555f44cdf8f0 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.937+0000 7f4c1a7fc640 10 client.25199 handle_command_reply: tid=0 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.937+0000 7f4c3b519740 1 client.25199 shutdown 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 msgr2=0x555f44cccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cccbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c240cd020 tx=0x7f4c2409c570 comp rx=0 tx=0).stop 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 shutdown_connections 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44cdf8f0 0x555f44ce1d40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44ccfd40 0x555f44ccd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44ccd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2820478007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44cc4b60 0x555f44cccbd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 >> 172.21.15.100:0/2820478007 conn(0x555f44cc10f0 msgr2=0x555f44cc6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c1a7fc640 0 client.25199 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 shutdown_connections 2024-09-12T02:08:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 1 -- 172.21.15.100:0/2820478007 wait complete. 2024-09-12T02:08:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.938+0000 7f4c3b519740 20 client.25199 trim_cache size 0 max 16384 2024-09-12T02:08:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.957+0000 7f4c3b519740 1 Processor -- start 2024-09-12T02:08:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.957+0000 7f4c3b519740 1 -- start start 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc4b60 0x555f44cc75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44cc0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44ce7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c3b519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341b2140 con 0x555f44cc5480 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c3b519740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341af9e0 con 0x555f44ccfd40 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c3b519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341ad830 con 0x555f44cc4b60 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44cc0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44cc0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59402/0 (socket says 172.21.15.100:59402) 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 -- 172.21.15.100:0/2530589593 learned_addr learned my addr 172.21.15.100:0/2530589593 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c3359e640 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44ce7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc4b60 0x555f44cc75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 -- 172.21.15.100:0/2530589593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc4b60 msgr2=0x555f44cc75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc4b60 0x555f44cc75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 -- 172.21.15.100:0/2530589593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 msgr2=0x555f44ce7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44ce7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.958+0000 7f4c2a59c640 1 -- 172.21.15.100:0/2530589593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f44ccf4a0 con 0x555f44cc5480 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.959+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44cc0160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x555f44cc2470 tx=0x7f4c1c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9802ef14f133428a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.959+0000 7f4c28d99640 1 -- 172.21.15.100:0/2530589593 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0119d0 con 0x555f44cc5480 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.959+0000 7f4c28d99640 1 -- 172.21.15.100:0/2530589593 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c1c005590 con 0x555f44cc5480 2024-09-12T02:08:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.959+0000 7f4c28d99640 1 -- 172.21.15.100:0/2530589593 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c003a90 con 0x555f44cc5480 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.959+0000 7f4c3b519740 1 -- 172.21.15.100:0/2530589593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 msgr2=0x555f44cc0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.959+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44cc0160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x555f44cc2470 tx=0x7f4c1c01e040 comp rx=0 tx=0).stop 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- 172.21.15.100:0/2530589593 shutdown_connections 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44ce7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc5480 0x555f44cc0160 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 --2- 172.21.15.100:0/2530589593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc4b60 0x555f44cc75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- 172.21.15.100:0/2530589593 >> 172.21.15.100:0/2530589593 conn(0x555f44cc10f0 msgr2=0x555f44cbfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- 172.21.15.100:0/2530589593 shutdown_connections 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- 172.21.15.100:0/2530589593 wait complete. 2024-09-12T02:08:27.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- start start 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 Processor -- start 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc4b60 0x555f44cd8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc5480 0x555f44cd3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44cd3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341adea0 con 0x555f44cc4b60 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341af310 con 0x555f44ccfd40 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341ae570 con 0x555f44cc5480 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c3b519740 10 client.0 _ll_register_callbacks cb 0x7f4c24009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c32d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc4b60 0x555f44cd8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c32d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc4b60 0x555f44cd8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59418/0 (socket says 172.21.15.100:59418) 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c32d9d640 1 -- 172.21.15.100:0/3687917538 learned_addr learned my addr 172.21.15.100:0/3687917538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.960+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc5480 0x555f44cd3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c3359e640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44cd3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c32d9d640 1 -- 172.21.15.100:0/3687917538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc5480 msgr2=0x555f44cd3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc5480 0x555f44cd3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c32d9d640 1 -- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 msgr2=0x555f44cd3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44cd3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c32d9d640 1 -- 172.21.15.100:0/3687917538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f44cd43d0 con 0x555f44cc4b60 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c3359e640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44cd3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c32d9d640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc4b60 0x555f44cd8330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400e9c0 tx=0x7f4c2409b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602724b6d31bab20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/3687917538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2409b690 con 0x555f44cc4b60 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/3687917538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4c24097a80 con 0x555f44cc4b60 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c005590 con 0x555f44cc4b60 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/3687917538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c24018c50 con 0x555f44cc4b60 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c3b519740 10 client.15696 fetch_fsmap learned FSMap version 26 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555f44d4a540 con 0x555f44cc4b60 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.961+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/3687917538 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c1c005590 con 0x555f44cc4b60 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/3687917538 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4c240a14b0 con 0x555f44cc4b60 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c3b519740 10 client.15696 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c3b519740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c3b519740 20 client.15696 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c3b519740 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44d4acb0 0x555f44d4d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c3b519740 4 client.15696 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555f44c31d00 con 0x555f44d4acb0 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44d4acb0 0x555f44d4d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c2a59c640 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44d4acb0 0x555f44d4d0d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f06d908a90a6704a server_cookie=31f1d64bb0914ada in_seq=0 out_seq=0 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.962+0000 7f4c1a7fc640 10 client.15696 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c1a7fc640 1 -- 172.21.15.100:0/3687917538 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555f44c31d00 con 0x555f44d4acb0 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c1a7fc640 10 client.15696 handle_command_reply: tid=0 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 client.15696 shutdown 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc4b60 msgr2=0x555f44cd8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc4b60 0x555f44cd8330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400e9c0 tx=0x7f4c2409b3b0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 shutdown_connections 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x555f44d4acb0 0x555f44d4d0d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f44ccfd40 0x555f44cd3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f44cc5480 0x555f44cd3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c1a7fc640 0 client.15696 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 --2- 172.21.15.100:0/3687917538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f44cc4b60 0x555f44cd8330 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 >> 172.21.15.100:0/3687917538 conn(0x555f44cc10f0 msgr2=0x555f44cc0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 shutdown_connections 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.963+0000 7f4c3b519740 1 -- 172.21.15.100:0/3687917538 wait complete. 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c3b519740 20 client.15696 trim_cache size 0 max 16384 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "933f65f6-ed87-4630-a9d2-b538694c71c7", 2024-09-12T02:08:27.969 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4c200a2b80 msgr2=0x7f4c200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4c200a2b80 0x7f4c200a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0099a0 tx=0x7f4c2c005c50 comp rx=0 tx=0).stop 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c34102de0 msgr2=0x7f4c34100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c34102de0 0x7f4c34100a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400e9f0 tx=0x7f4c2400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 shutdown_connections 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4c200a2b80 0x7f4c200a5040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c3410c180 0x7f4c341014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c34103700 0x7f4c34100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 --2- 172.21.15.100:0/1749997105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c34102de0 0x7f4c34100a40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 >> 172.21.15.100:0/1749997105 conn(0x7f4c340fc7a0 msgr2=0x7f4c340fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 shutdown_connections 2024-09-12T02:08:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:27.964+0000 7f4c39140640 1 -- 172.21.15.100:0/1749997105 wait complete. 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:28.356 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:28.357 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-12T02:08:28.360 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:28.362 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-12T02:08:28.362 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:28.362 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:28.362 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:28.362 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-12T02:08:28.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:28 smithi100 ceph-mon[31179]: scrub queued for path: / 2024-09-12T02:08:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:28 smithi100 ceph-mon[31179]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:28 smithi100 ceph-mon[31179]: scrub summary: active paths [/] 2024-09-12T02:08:28.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:28 smithi100 ceph-mon[31179]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:28 smithi189 ceph-mon[35188]: scrub queued for path: / 2024-09-12T02:08:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:28 smithi189 ceph-mon[35188]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:28 smithi189 ceph-mon[35188]: scrub summary: active paths [/] 2024-09-12T02:08:28.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:28 smithi189 ceph-mon[35188]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:28 smithi117 ceph-mon[35240]: scrub queued for path: / 2024-09-12T02:08:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:28 smithi117 ceph-mon[35240]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:28 smithi117 ceph-mon[35240]: scrub summary: active paths [/] 2024-09-12T02:08:28.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:28 smithi117 ceph-mon[35240]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:28.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-12T02:08:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:28.712 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-12T02:08:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-12T02:08:28.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:08:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:29.070 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:29.070 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:29.070 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:29.070 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-12T02:08:29.070 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:29.073 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:29.074 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:29.075 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:29.076 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:29.076 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-12T02:08:29.076 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:29.076 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:29.076 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:29.076 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-12T02:08:29.076 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:29.402 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:29 smithi100 ceph-mon[31179]: scrub summary: active paths [/] 2024-09-12T02:08:29.402 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:29 smithi100 ceph-mon[31179]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:29.402 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:29 smithi100 ceph-mon[31179]: pgmap v375: 97 pgs: 97 active+clean; 178 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s rd, 1.3 MiB/s wr, 2.67k op/s 2024-09-12T02:08:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 -- 172.21.15.100:0/2015295831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 msgr2=0x7f53c410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 --2- 172.21.15.100:0/2015295831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c410d7a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009cd0 tx=0x7f53bc02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 -- 172.21.15.100:0/2015295831 shutdown_connections 2024-09-12T02:08:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 --2- 172.21.15.100:0/2015295831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c410d7a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 --2- 172.21.15.100:0/2015295831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c41008d0 0x7f53c4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 --2- 172.21.15.100:0/2015295831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c41068d0 0x7f53c4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 -- 172.21.15.100:0/2015295831 >> 172.21.15.100:0/2015295831 conn(0x7f53c40fc610 msgr2=0x7f53c40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 -- 172.21.15.100:0/2015295831 shutdown_connections 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.517+0000 7f53c3fff640 1 -- 172.21.15.100:0/2015295831 wait complete. 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 Processor -- start 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 -- start start 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c41008d0 0x7f53c41024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c41029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c41068d0 0x7f53c4102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4110cd0 con 0x7f53c4101270 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4110b50 con 0x7f53c41068d0 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c3fff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4110e50 con 0x7f53c41008d0 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c41029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.518+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c41029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59436/0 (socket says 172.21.15.100:59436) 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c27fc640 1 -- 172.21.15.100:0/836238056 learned_addr learned my addr 172.21.15.100:0/836238056 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c37fe640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c41068d0 0x7f53c4102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c41008d0 0x7f53c41024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c27fc640 1 -- 172.21.15.100:0/836238056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c41008d0 msgr2=0x7f53c41024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c27fc640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c41008d0 0x7f53c41024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c27fc640 1 -- 172.21.15.100:0/836238056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c41068d0 msgr2=0x7f53c4102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c27fc640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c41068d0 0x7f53c4102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c27fc640 1 -- 172.21.15.100:0/836238056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c41a6610 con 0x7f53c4101270 2024-09-12T02:08:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c41008d0 0x7f53c41024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c27fc640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c41029e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f53b800c920 tx=0x7f53b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c89fd640 1 -- 172.21.15.100:0/836238056 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8007c70 con 0x7f53c4101270 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c89fd640 1 -- 172.21.15.100:0/836238056 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53b8007e10 con 0x7f53c4101270 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c89fd640 1 -- 172.21.15.100:0/836238056 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8018890 con 0x7f53c4101270 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c41a6900 con 0x7f53c4101270 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.519+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c41a6df0 con 0x7f53c4101270 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.522+0000 7f53c89fd640 1 -- 172.21.15.100:0/836238056 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f53b8018a70 con 0x7f53c4101270 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.522+0000 7f53cbdd8740 1 Processor -- start 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.522+0000 7f53cbdd8740 1 -- start start 2024-09-12T02:08:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e878a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e883310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e885c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56224e7de2e0 con 0x56224e883850 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56224e785ce0 con 0x56224e878f90 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56224e7da2a0 con 0x56224e878670 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c89fd640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53ac0a2b80 0x7f53ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e878a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e878a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:42242/0 (socket says 172.21.15.100:42242) 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 -- 172.21.15.100:0/1693809118 learned_addr learned my addr 172.21.15.100:0/1693809118 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53ac0a2b80 0x7f53ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c89fd640 1 -- 172.21.15.100:0/836238056 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f53b80cf180 con 0x7f53c4101270 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 -- 172.21.15.100:0/1693809118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 msgr2=0x56224e883310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 --2- 172.21.15.100:0/1693809118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e883310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 -- 172.21.15.100:0/1693809118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 msgr2=0x56224e885c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 --2- 172.21.15.100:0/1693809118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e885c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.523+0000 7f53c37fe640 1 -- 172.21.15.100:0/1693809118 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224e76a440 con 0x56224e878670 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.524+0000 7f53c37fe640 1 --2- 172.21.15.100:0/1693809118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e878a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009cd0 tx=0x7f53bc031c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0652902213d98e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.524+0000 7f53c37fe640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53ac0a2b80 0x7f53ac0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f53bc047000 tx=0x7f53bc04a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.524+0000 7f53a9ffb640 1 -- 172.21.15.100:0/1693809118 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0044d0 con 0x56224e878670 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.524+0000 7f53a9ffb640 1 -- 172.21.15.100:0/1693809118 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53bc04e020 con 0x56224e878670 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.524+0000 7f53a9ffb640 1 -- 172.21.15.100:0/1693809118 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc04a6b0 con 0x56224e878670 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1693809118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 msgr2=0x56224e878a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1693809118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e878a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009cd0 tx=0x7f53bc031c10 comp rx=0 tx=0).stop 2024-09-12T02:08:29.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1693809118 shutdown_connections 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1693809118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e885c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1693809118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e883310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1693809118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e878a50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1693809118 >> 172.21.15.100:0/1693809118 conn(0x56224e874c00 msgr2=0x56224e874fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1693809118 shutdown_connections 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1693809118 wait complete. 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 -- start start 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.525+0000 7f53cbdd8740 1 Processor -- start 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e8832b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e880560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e883850 0x56224e880cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56224e886420 con 0x56224e878f90 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56224e799050 con 0x56224e883850 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56224e8865a0 con 0x56224e878670 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53cbdd8740 10 client.0 _ll_register_callbacks cb 0x56224e7d9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e880560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e880560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59458/0 (socket says 172.21.15.100:59458) 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53c27fc640 1 -- 172.21.15.100:0/1642396675 learned_addr learned my addr 172.21.15.100:0/1642396675 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e8832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.527+0000 7f53c37fe640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e883850 0x56224e880cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53c27fc640 1 -- 172.21.15.100:0/1642396675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 msgr2=0x56224e8832b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53c27fc640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e8832b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53c27fc640 1 -- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e883850 msgr2=0x56224e880cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53c27fc640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e883850 0x56224e880cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53c27fc640 1 -- 172.21.15.100:0/1642396675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224e54f3c0 con 0x56224e878f90 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53c37fe640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e883850 0x56224e880cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53c27fc640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e880560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f53b809b980 tx=0x7f53b809b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcca9866bea3d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53a2ffd640 1 -- 172.21.15.100:0/1642396675 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b809be90 con 0x56224e878f90 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53a2ffd640 1 -- 172.21.15.100:0/1642396675 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f53b800fb30 con 0x56224e878f90 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53bc04e020 con 0x56224e878f90 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53a2ffd640 1 -- 172.21.15.100:0/1642396675 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f53b809fda0 con 0x56224e878f90 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.528+0000 7f53cbdd8740 10 client.15705 fetch_fsmap learned FSMap version 26 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56224e891f60 con 0x56224e878f90 2024-09-12T02:08:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53a2ffd640 1 -- 172.21.15.100:0/1642396675 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53bc04e020 con 0x56224e878f90 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53a2ffd640 1 -- 172.21.15.100:0/1642396675 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f53b809c460 con 0x56224e878f90 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53cbdd8740 10 client.15705 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53cbdd8740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53cbdd8740 20 client.15705 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8933c0 0x56224e8957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53cbdd8740 4 client.15705 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.529+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56224e7eb850 con 0x56224e8933c0 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.530+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8933c0 0x56224e8957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.530+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8933c0 0x56224e8957d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a4a3171f0ce8b2 server_cookie=186698c38dd48db1 in_seq=0 out_seq=0 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.530+0000 7f53a2ffd640 10 client.15705 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53a2ffd640 1 -- 172.21.15.100:0/1642396675 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56224e7eb850 con 0x56224e8933c0 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53a2ffd640 10 client.15705 handle_command_reply: tid=0 2024-09-12T02:08:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 client.15705 shutdown 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 msgr2=0x56224e880560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e880560 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f53b809b980 tx=0x7f53b809b410 comp rx=0 tx=0).stop 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 shutdown_connections 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8933c0 0x56224e8957d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e883850 0x56224e880cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e880560 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/1642396675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e8832b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 >> 172.21.15.100:0/1642396675 conn(0x56224e874c00 msgr2=0x56224e87a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53a2ffd640 0 client.15705 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 shutdown_connections 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 1 -- 172.21.15.100:0/1642396675 wait complete. 2024-09-12T02:08:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.531+0000 7f53cbdd8740 20 client.15705 trim_cache size 0 max 16384 2024-09-12T02:08:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.548+0000 7f53cbdd8740 1 Processor -- start 2024-09-12T02:08:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.548+0000 7f53cbdd8740 1 -- start start 2024-09-12T02:08:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878670 0x56224e89b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e89b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e883850 0x56224e87d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41b1db0 con 0x56224e878f90 2024-09-12T02:08:29.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41af650 con 0x56224e878670 2024-09-12T02:08:29.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41ad4a0 con 0x56224e883850 2024-09-12T02:08:29.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e89b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878670 0x56224e89b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e89b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59470/0 (socket says 172.21.15.100:59470) 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 -- 172.21.15.100:0/3411704002 learned_addr learned my addr 172.21.15.100:0/3411704002 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c37fe640 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e883850 0x56224e87d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 -- 172.21.15.100:0/3411704002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e883850 msgr2=0x56224e87d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e883850 0x56224e87d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 -- 172.21.15.100:0/3411704002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878670 msgr2=0x56224e89b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878670 0x56224e89b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 -- 172.21.15.100:0/3411704002 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224e875d70 con 0x56224e878f90 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.549+0000 7f53c27fc640 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e89b5e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f53b809c940 tx=0x7f53b80cf4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6f960b520badd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53a97fa640 1 -- 172.21.15.100:0/3411704002 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b800fb30 con 0x56224e878f90 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53a97fa640 1 -- 172.21.15.100:0/3411704002 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53b80ba2e0 con 0x56224e878f90 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53a97fa640 1 -- 172.21.15.100:0/3411704002 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b809c380 con 0x56224e878f90 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 -- 172.21.15.100:0/3411704002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 msgr2=0x56224e89b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e89b5e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f53b809c940 tx=0x7f53b80cf4f0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 -- 172.21.15.100:0/3411704002 shutdown_connections 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e883850 0x56224e87d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e878f90 0x56224e89b5e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/3411704002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878670 0x56224e89b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 -- 172.21.15.100:0/3411704002 >> 172.21.15.100:0/3411704002 conn(0x56224e874c00 msgr2=0x56224e87a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 -- 172.21.15.100:0/3411704002 shutdown_connections 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.550+0000 7f53cbdd8740 1 -- 172.21.15.100:0/3411704002 wait complete. 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 -- start start 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 Processor -- start 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e887850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e887d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e888310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41adb10 con 0x56224e883850 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41aef80 con 0x56224e878f90 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41ae1e0 con 0x56224e878670 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53c37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e888310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53cbdd8740 10 client.0 _ll_register_callbacks cb 0x7f53b800fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.551+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e887d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e888310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59482/0 (socket says 172.21.15.100:59482) 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 -- 172.21.15.100:0/759426985 learned_addr learned my addr 172.21.15.100:0/759426985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c27fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e887d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:49058/0 (socket says 172.21.15.100:49058) 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e887850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 -- 172.21.15.100:0/759426985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 msgr2=0x56224e887850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e887850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 -- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 msgr2=0x56224e887d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e887d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 -- 172.21.15.100:0/759426985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224e8fd360 con 0x56224e883850 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e887850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c27fc640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e887d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:29.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53c37fe640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e888310 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f53bc02ae00 tx=0x7f53bc005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8ee7ee61fe7563 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53a2ffd640 1 -- 172.21.15.100:0/759426985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc059030 con 0x56224e883850 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53a2ffd640 1 -- 172.21.15.100:0/759426985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f53bc030a60 con 0x56224e883850 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.552+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53b80ba2e0 con 0x56224e883850 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53a2ffd640 1 -- 172.21.15.100:0/759426985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f53bc030c60 con 0x56224e883850 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 10 client.15711 fetch_fsmap learned FSMap version 26 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56224e8fe670 con 0x56224e883850 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53a2ffd640 1 -- 172.21.15.100:0/759426985 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53bc04e040 con 0x56224e883850 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53a2ffd640 1 -- 172.21.15.100:0/759426985 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f53bc030070 con 0x56224e883850 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 10 client.15711 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 20 client.15711 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8fea00 0x56224e900df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 4 client.15711 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f53b80ba2e0 con 0x56224e8fea00 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.553+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8fea00 0x56224e900df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53a2ffd640 10 client.15711 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53c2ffd640 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8fea00 0x56224e900df0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ec3e9f4655a81db server_cookie=e42724517ae9f039 in_seq=0 out_seq=0 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53a2ffd640 1 -- 172.21.15.100:0/759426985 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f53b80ba2e0 con 0x56224e8fea00 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53a2ffd640 10 client.15711 handle_command_reply: tid=0 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53cbdd8740 1 client.15711 shutdown 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 msgr2=0x56224e888310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e888310 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f53bc02ae00 tx=0x7f53bc005df0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 shutdown_connections 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.554+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x56224e8fea00 0x56224e900df0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56224e883850 0x56224e888310 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56224e878f90 0x56224e887d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53cbdd8740 1 --2- 172.21.15.100:0/759426985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56224e878670 0x56224e887850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53a2ffd640 0 client.15711 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 >> 172.21.15.100:0/759426985 conn(0x56224e874c00 msgr2=0x56224e87b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 shutdown_connections 2024-09-12T02:08:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53cbdd8740 1 -- 172.21.15.100:0/759426985 wait complete. 2024-09-12T02:08:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53cbdd8740 20 client.15711 trim_cache size 0 max 16384 2024-09-12T02:08:29.564 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: "933f65f6-ed87-4630-a9d2-b538694c71c7": { 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "933f65f6-ed87-4630-a9d2-b538694c71c7", 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:08:29.565 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53ac0a2b80 msgr2=0x7f53ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53c3fff640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53ac0a2b80 0x7f53ac0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f53bc047000 tx=0x7f53bc04a000 comp rx=0 tx=0).stop 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 msgr2=0x7f53c41029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53c3fff640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c41029e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f53b800c920 tx=0x7f53b800cde0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 shutdown_connections 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.555+0000 7f53c3fff640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f53ac0a2b80 0x7f53ac0a5040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.556+0000 7f53c3fff640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53c41068d0 0x7f53c4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.556+0000 7f53c3fff640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c4101270 0x7f53c41029e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.556+0000 7f53c3fff640 1 --2- 172.21.15.100:0/836238056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53c41008d0 0x7f53c41024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.556+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 >> 172.21.15.100:0/836238056 conn(0x7f53c40fc610 msgr2=0x7f53c406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.556+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 shutdown_connections 2024-09-12T02:08:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:29.556+0000 7f53c3fff640 1 -- 172.21.15.100:0/836238056 wait complete. 2024-09-12T02:08:29.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:29 smithi189 ceph-mon[35188]: scrub summary: active paths [/] 2024-09-12T02:08:29.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:29 smithi189 ceph-mon[35188]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:29.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:29 smithi189 ceph-mon[35188]: pgmap v375: 97 pgs: 97 active+clean; 178 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s rd, 1.3 MiB/s wr, 2.67k op/s 2024-09-12T02:08:29.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:29 smithi117 ceph-mon[35240]: scrub summary: active paths [/] 2024-09-12T02:08:29.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:29 smithi117 ceph-mon[35240]: scrub summary: idle+waiting paths [/] 2024-09-12T02:08:29.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:29 smithi117 ceph-mon[35240]: pgmap v375: 97 pgs: 97 active+clean; 178 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s rd, 1.3 MiB/s wr, 2.67k op/s 2024-09-12T02:08:29.774 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:29.774 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-12T02:08:29.777 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:29.778 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:29.778 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:29.778 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-12T02:08:29.778 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:29.778 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:29.778 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-12T02:08:29.779 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:29.781 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-12T02:08:29.782 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:29.782 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:30.295 INFO:tasks.cephfs.filesystem:scrub status for tag:933f65f6-ed87-4630-a9d2-b538694c71c7 - {'path': '/', 'tag': '933f65f6-ed87-4630-a9d2-b538694c71c7', 'options': 'recursive,force'} 2024-09-12T02:08:30.384 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:30.384 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-12T02:08:30.384 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-12T02:08:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-12T02:08:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:30.389 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-12T02:08:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:30.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-12T02:08:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-12T02:08:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-12T02:08:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:30.774 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:30.774 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:30.774 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-12T02:08:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:31.215 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:31.220 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:31.220 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-12T02:08:31.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:31 smithi100 ceph-mon[31179]: pgmap v376: 97 pgs: 97 active+clean; 158 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 114 MiB/s rd, 1.5 MiB/s wr, 813 op/s 2024-09-12T02:08:31.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:31 smithi189 ceph-mon[35188]: pgmap v376: 97 pgs: 97 active+clean; 158 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 114 MiB/s rd, 1.5 MiB/s wr, 813 op/s 2024-09-12T02:08:31.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:31 smithi117 ceph-mon[35240]: pgmap v376: 97 pgs: 97 active+clean; 158 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 114 MiB/s rd, 1.5 MiB/s wr, 813 op/s 2024-09-12T02:08:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-12T02:08:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:31.865 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:31.866 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-12T02:08:31.866 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:31.866 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:31.868 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:31.868 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-12T02:08:31.869 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:31.869 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:31.869 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:31.869 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-12T02:08:31.870 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:31.870 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:31.870 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:31.870 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-12T02:08:31.871 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:31.871 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:31.871 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:31.871 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:31.872 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:31.873 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:31.874 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-12T02:08:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:31.876 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:31.876 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:31.876 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-12T02:08:31.876 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:32.438 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:32.438 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:32.438 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-12T02:08:32.438 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:32.438 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:32.438 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:32.438 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-12T02:08:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:32.442 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-12T02:08:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-12T02:08:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:32.765 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:32.765 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-12T02:08:32.765 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:32.765 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:32.766 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:32.767 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-12T02:08:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:32.769 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:32.770 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-12T02:08:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-12T02:08:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:33.240 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:33.241 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-12T02:08:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:33.244 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-12T02:08:33.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:33 smithi100 ceph-mon[31179]: pgmap v377: 97 pgs: 97 active+clean; 156 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s rd, 1.4 MiB/s wr, 848 op/s 2024-09-12T02:08:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:33 smithi189 ceph-mon[35188]: pgmap v377: 97 pgs: 97 active+clean; 156 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s rd, 1.4 MiB/s wr, 848 op/s 2024-09-12T02:08:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:33 smithi117 ceph-mon[35240]: pgmap v377: 97 pgs: 97 active+clean; 156 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s rd, 1.4 MiB/s wr, 848 op/s 2024-09-12T02:08:33.844 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:33.845 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:33.846 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-12T02:08:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-12T02:08:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:33.851 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:33.851 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:33.851 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-12T02:08:34.273 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:34.273 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-12T02:08:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:34.277 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-12T02:08:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-12T02:08:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:34.648 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:34.649 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-12T02:08:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:34.653 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:34.710 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:34.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:34.711 INFO:tasks.workunit.client.0.smithi100.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-12T02:08:34.711 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:08:34.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:08:34.754 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-09-12T02:08:34.754 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:08:35.086 DEBUG:teuthology.parallel:result is None 2024-09-12T02:08:35.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:08:35.117 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:08:35.118 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T02:08:35.274 INFO:tasks.quiescer:joining Quiescers 2024-09-12T02:08:35.274 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T02:08:35.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:08:35.522 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:35.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:35 smithi100 ceph-mon[31179]: pgmap v378: 97 pgs: 97 active+clean; 128 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 1.4 MiB/s wr, 523 op/s 2024-09-12T02:08:35.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:35 smithi189 ceph-mon[35188]: pgmap v378: 97 pgs: 97 active+clean; 128 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 1.4 MiB/s wr, 523 op/s 2024-09-12T02:08:35.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:35 smithi117 ceph-mon[35240]: pgmap v378: 97 pgs: 97 active+clean; 128 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 1.4 MiB/s wr, 523 op/s 2024-09-12T02:08:35.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 -- 172.21.15.100:0/3282379136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac103660 msgr2=0x7f7dac10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 --2- 172.21.15.100:0/3282379136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac103660 0x7f7dac10bb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009900 tx=0x7f7d9c02a480 comp rx=0 tx=0).stop 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 -- 172.21.15.100:0/3282379136 shutdown_connections 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 --2- 172.21.15.100:0/3282379136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac10c170 0x7f7dac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 --2- 172.21.15.100:0/3282379136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac103660 0x7f7dac10bb50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 --2- 172.21.15.100:0/3282379136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dac102d40 0x7f7dac103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 -- 172.21.15.100:0/3282379136 >> 172.21.15.100:0/3282379136 conn(0x7f7dac0fc7a0 msgr2=0x7f7dac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 -- 172.21.15.100:0/3282379136 shutdown_connections 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 -- 172.21.15.100:0/3282379136 wait complete. 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 Processor -- start 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.982+0000 7f7db3f02640 1 -- start start 2024-09-12T02:08:35.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac102d40 0x7f7dac198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dac103660 0x7f7dac198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac10c170 0x7f7dac19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac111f70 con 0x7f7dac102d40 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac111df0 con 0x7f7dac10c170 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1120f0 con 0x7f7dac103660 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac102d40 0x7f7dac198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac102d40 0x7f7dac198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48416/0 (socket says 172.21.15.100:48416) 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 -- 172.21.15.100:0/2769083440 learned_addr learned my addr 172.21.15.100:0/2769083440 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db149d640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dac103660 0x7f7dac198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db249f640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac10c170 0x7f7dac19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 -- 172.21.15.100:0/2769083440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dac103660 msgr2=0x7f7dac198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dac103660 0x7f7dac198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:35.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 -- 172.21.15.100:0/2769083440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac10c170 msgr2=0x7f7dac19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac10c170 0x7f7dac19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 -- 172.21.15.100:0/2769083440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac19d3e0 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db249f640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac10c170 0x7f7dac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db1c9e640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac102d40 0x7f7dac198430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7da800d770 tx=0x7f7da800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7da2ffd640 1 -- 172.21.15.100:0/2769083440 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8017070 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7da2ffd640 1 -- 172.21.15.100:0/2769083440 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da8005500 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac19d6d0 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7da2ffd640 1 -- 172.21.15.100:0/2769083440 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8004e00 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.983+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac1a4fb0 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.984+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac103120 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.985+0000 7f7da2ffd640 1 -- 172.21.15.100:0/2769083440 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7da8004fa0 con 0x7f7dac102d40 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.986+0000 7f7da2ffd640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d980a2b80 0x7f7d980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:35.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.986+0000 7f7db149d640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d980a2b80 0x7f7d980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:35.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.986+0000 7f7da2ffd640 1 -- 172.21.15.100:0/2769083440 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7da80cebc0 con 0x7f7dac102d40 2024-09-12T02:08:35.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.987+0000 7f7db149d640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d980a2b80 0x7f7d980a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7dac10d5b0 tx=0x7f7d9c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:35.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:35.990+0000 7f7da2ffd640 1 -- 172.21.15.100:0/2769083440 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7da809bad0 con 0x7f7dac102d40 2024-09-12T02:08:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.195+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dac1071e0 con 0x7f7dac102d40 2024-09-12T02:08:36.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.196+0000 7f7da2ffd640 1 -- 172.21.15.100:0/2769083440 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11931 (secure 0 0 0) 0x7f7da809b3d0 con 0x7f7dac102d40 2024-09-12T02:08:36.196 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:08:36.196 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:08:26:210418+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:08:25.469043+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:08:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.198+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d980a2b80 msgr2=0x7f7d980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.198+0000 7f7db3f02640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d980a2b80 0x7f7d980a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7dac10d5b0 tx=0x7f7d9c005a20 comp rx=0 tx=0).stop 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.198+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac102d40 msgr2=0x7f7dac198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.198+0000 7f7db3f02640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac102d40 0x7f7dac198430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7da800d770 tx=0x7f7da800dc30 comp rx=0 tx=0).stop 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 shutdown_connections 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f7d980a2b80 0x7f7d980a5040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac10c170 0x7f7dac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dac103660 0x7f7dac198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 --2- 172.21.15.100:0/2769083440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac102d40 0x7f7dac198430 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 >> 172.21.15.100:0/2769083440 conn(0x7f7dac0fc7a0 msgr2=0x7f7dac0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 shutdown_connections 2024-09-12T02:08:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:36.199+0000 7f7db3f02640 1 -- 172.21.15.100:0/2769083440 wait complete. 2024-09-12T02:08:36.555 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:36 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2769083440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:08:36.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:36 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2769083440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:08:36.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:36 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2769083440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:08:36.850 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db --cancel --all' 2024-09-12T02:08:36.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db --cancel --all 2024-09-12T02:08:37.094 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:37.543 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:37 smithi100 ceph-mon[31179]: pgmap v379: 97 pgs: 97 active+clean; 90 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 152 MiB/s rd, 1.1 MiB/s wr, 501 op/s 2024-09-12T02:08:37.544 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:37 smithi100 ceph-mon[31179]: scrub summary: idle 2024-09-12T02:08:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:37 smithi189 ceph-mon[35188]: pgmap v379: 97 pgs: 97 active+clean; 90 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 152 MiB/s rd, 1.1 MiB/s wr, 501 op/s 2024-09-12T02:08:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:37 smithi189 ceph-mon[35188]: scrub summary: idle 2024-09-12T02:08:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:37 smithi117 ceph-mon[35240]: pgmap v379: 97 pgs: 97 active+clean; 90 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 152 MiB/s rd, 1.1 MiB/s wr, 501 op/s 2024-09-12T02:08:37.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:37 smithi117 ceph-mon[35240]: scrub summary: idle 2024-09-12T02:08:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 -- 172.21.15.100:0/312540254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 msgr2=0x7f91281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 --2- 172.21.15.100:0/312540254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91281021c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9118009900 tx=0x7f911802a410 comp rx=0 tx=0).stop 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 -- 172.21.15.100:0/312540254 shutdown_connections 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 --2- 172.21.15.100:0/312540254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9128106f10 0x7f912810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 --2- 172.21.15.100:0/312540254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128102790 0x7f91281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 --2- 172.21.15.100:0/312540254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91281021c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 -- 172.21.15.100:0/312540254 >> 172.21.15.100:0/312540254 conn(0x7f91280fd8c0 msgr2=0x7f91280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 -- 172.21.15.100:0/312540254 shutdown_connections 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.625+0000 7f912de6d640 1 -- 172.21.15.100:0/312540254 wait complete. 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 Processor -- start 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 -- start start 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128102790 0x7f9128074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9128106f10 0x7f9128074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9128111f70 con 0x7f9128101de0 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9128111df0 con 0x7f9128106f10 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f912de6d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91281120f0 con 0x7f9128102790 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f91277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f91277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91280744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48430/0 (socket says 172.21.15.100:48430) 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f91277fe640 1 -- 172.21.15.100:0/3628019013 learned_addr learned my addr 172.21.15.100:0/3628019013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.626+0000 7f911ffff640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128102790 0x7f9128074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f9127fff640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9128106f10 0x7f9128074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91277fe640 1 -- 172.21.15.100:0/3628019013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128102790 msgr2=0x7f9128074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91277fe640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128102790 0x7f9128074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91277fe640 1 -- 172.21.15.100:0/3628019013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9128106f10 msgr2=0x7f9128074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91277fe640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9128106f10 0x7f9128074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91277fe640 1 -- 172.21.15.100:0/3628019013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91281a68b0 con 0x7f9128101de0 2024-09-12T02:08:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f911ffff640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128102790 0x7f9128074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91277fe640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91280744f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9118006010 tx=0x7f91180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91257fa640 1 -- 172.21.15.100:0/3628019013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911803f030 con 0x7f9128101de0 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281a6b40 con 0x7f9128101de0 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91257fa640 1 -- 172.21.15.100:0/3628019013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9118003ce0 con 0x7f9128101de0 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f91257fa640 1 -- 172.21.15.100:0/3628019013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118035070 con 0x7f9128101de0 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.627+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91281a7020 con 0x7f9128101de0 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.629+0000 7f91257fa640 1 -- 172.21.15.100:0/3628019013 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9118042030 con 0x7f9128101de0 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 Processor -- start 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 -- start start 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91257fa640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f91140a2b80 0x7f91140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b2320 0x5625910bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910bcbe0 0x5625910befd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562591016200 con 0x5625910b1a00 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562590fbcdc0 con 0x5625910bcbe0 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9130246740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625910121c0 con 0x5625910b2320 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9127fff640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f91140a2b80 0x7f91140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48434/0 (socket says 172.21.15.100:48434) 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 -- 172.21.15.100:0/2709233403 learned_addr learned my addr 172.21.15.100:0/2709233403 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91257fa640 1 -- 172.21.15.100:0/3628019013 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91180ef650 con 0x7f9128101de0 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f911ffff640 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b2320 0x5625910bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9127fff640 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910bcbe0 0x5625910befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 -- 172.21.15.100:0/2709233403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b2320 msgr2=0x5625910bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b2320 0x5625910bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 -- 172.21.15.100:0/2709233403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910bcbe0 msgr2=0x5625910befd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910bcbe0 0x5625910befd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f91277fe640 1 -- 172.21.15.100:0/2709233403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562590d87620 con 0x5625910b1a00 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.630+0000 7f9127fff640 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910bcbe0 0x5625910befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f91277fe640 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910b1de0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f91180c4660 tx=0x7f9118049bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fca56fe1b27a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9127fff640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f91140a2b80 0x7f91140a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5625910af310 tx=0x7f912000a790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f911dffb640 1 -- 172.21.15.100:0/2709233403 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118049070 con 0x5625910b1a00 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f911dffb640 1 -- 172.21.15.100:0/2709233403 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f911803b580 con 0x5625910b1a00 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f911dffb640 1 -- 172.21.15.100:0/2709233403 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91180c02d0 con 0x5625910b1a00 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 -- 172.21.15.100:0/2709233403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 msgr2=0x5625910b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910b1de0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f91180c4660 tx=0x7f9118049bd0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 -- 172.21.15.100:0/2709233403 shutdown_connections 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910bcbe0 0x5625910befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b2320 0x5625910bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 --2- 172.21.15.100:0/2709233403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910b1de0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 -- 172.21.15.100:0/2709233403 >> 172.21.15.100:0/2709233403 conn(0x5625910adf90 msgr2=0x5625910ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 -- 172.21.15.100:0/2709233403 shutdown_connections 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.631+0000 7f9130246740 1 -- 172.21.15.100:0/2709233403 wait complete. 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 -- start start 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 Processor -- start 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b1a00 0x5625910bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910bcbe0 0x5625910b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5625910bf570 con 0x5625910b2320 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562590fb0c50 con 0x5625910b1a00 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625910bf6f0 con 0x5625910bcbe0 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f9130246740 10 client.0 _ll_register_callbacks cb 0x562590fc2ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f911ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f911ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910b97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48436/0 (socket says 172.21.15.100:48436) 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.632+0000 7f911ffff640 1 -- 172.21.15.100:0/2918306232 learned_addr learned my addr 172.21.15.100:0/2918306232 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f91277fe640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b1a00 0x5625910bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9127fff640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910bcbe0 0x5625910b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f911ffff640 1 -- 172.21.15.100:0/2918306232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910bcbe0 msgr2=0x5625910b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f911ffff640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910bcbe0 0x5625910b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f911ffff640 1 -- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b1a00 msgr2=0x5625910bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f911ffff640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b1a00 0x5625910bc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f911ffff640 1 -- 172.21.15.100:0/2918306232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625910ba540 con 0x5625910b2320 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f91277fe640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b1a00 0x5625910bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f911ffff640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910b97d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f911000bf40 tx=0x7f9110011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863d6ab63b5e4fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9106ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:37.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9106ffd640 1 -- 172.21.15.100:0/2918306232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110005220 con 0x5625910b2320 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9106ffd640 1 -- 172.21.15.100:0/2918306232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91100053c0 con 0x5625910b2320 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562591023770 con 0x5625910b2320 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9106ffd640 1 -- 172.21.15.100:0/2918306232 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f91100055c0 con 0x5625910b2320 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9130246740 10 client.15729 fetch_fsmap learned FSMap version 26 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5625910cb030 con 0x5625910b2320 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9106ffd640 1 -- 172.21.15.100:0/2918306232 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562591023770 con 0x5625910b2320 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.633+0000 7f9106ffd640 1 -- 172.21.15.100:0/2918306232 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9110012a90 con 0x5625910b2320 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f9130246740 10 client.15729 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f9130246740 10 client.15729 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f9130246740 20 client.15729 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f9130246740 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910cc590 0x5625910ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f9130246740 4 client.15729 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:08:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56259101dc80 con 0x5625910cc590 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f91277fe640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910cc590 0x5625910ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f91277fe640 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910cc590 0x5625910ce9f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a64672e81d2fbaa server_cookie=782e010b47d6f358 in_seq=0 out_seq=0 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.634+0000 7f9106ffd640 10 client.15729 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9106ffd640 1 -- 172.21.15.100:0/2918306232 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56259101dc80 con 0x5625910cc590 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9106ffd640 10 client.15729 handle_command_reply: tid=0 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 client.15729 shutdown 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 msgr2=0x5625910b97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910b97d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f911000bf40 tx=0x7f9110011870 comp rx=0 tx=0).stop 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 shutdown_connections 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910cc590 0x5625910ce9f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910bcbe0 0x5625910b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910b97d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9106ffd640 0 client.15729 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 --2- 172.21.15.100:0/2918306232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b1a00 0x5625910bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 >> 172.21.15.100:0/2918306232 conn(0x5625910adf90 msgr2=0x5625910ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 shutdown_connections 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 1 -- 172.21.15.100:0/2918306232 wait complete. 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.635+0000 7f9130246740 20 client.15729 trim_cache size 0 max 16384 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 Processor -- start 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 -- start start 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910adf90 0x5625910bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b1a00 0x5625910b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91281b1f80 con 0x5625910b2320 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f91281af820 con 0x5625910adf90 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9130246740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91281ad670 con 0x5625910b1a00 2024-09-12T02:08:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9127fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9127fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48450/0 (socket says 172.21.15.100:48450) 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.652+0000 7f9127fff640 1 -- 172.21.15.100:0/3493675693 learned_addr learned my addr 172.21.15.100:0/3493675693 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f91277fe640 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910adf90 0x5625910bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f9127fff640 1 -- 172.21.15.100:0/3493675693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b1a00 msgr2=0x5625910b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f9127fff640 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b1a00 0x5625910b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f9127fff640 1 -- 172.21.15.100:0/3493675693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910adf90 msgr2=0x5625910bb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f9127fff640 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910adf90 0x5625910bb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f9127fff640 1 -- 172.21.15.100:0/3493675693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625910addc0 con 0x5625910b2320 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f9127fff640 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910c8610 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f912000a650 tx=0x7f912000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa5a7ae98b3802c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f911d7fa640 1 -- 172.21.15.100:0/3493675693 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120011a50 con 0x5625910b2320 2024-09-12T02:08:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f911d7fa640 1 -- 172.21.15.100:0/3493675693 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9120019040 con 0x5625910b2320 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.653+0000 7f911d7fa640 1 -- 172.21.15.100:0/3493675693 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200203c0 con 0x5625910b2320 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- 172.21.15.100:0/3493675693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 msgr2=0x5625910c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910c8610 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f912000a650 tx=0x7f912000e000 comp rx=0 tx=0).stop 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- 172.21.15.100:0/3493675693 shutdown_connections 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b2320 0x5625910c8610 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910b1a00 0x5625910b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 --2- 172.21.15.100:0/3493675693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910adf90 0x5625910bb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- 172.21.15.100:0/3493675693 >> 172.21.15.100:0/3493675693 conn(0x5625910b9e70 msgr2=0x5625910b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- 172.21.15.100:0/3493675693 shutdown_connections 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- 172.21.15.100:0/3493675693 wait complete. 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- start start 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 Processor -- start 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910adf90 0x5625910c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b2320 0x562591138b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91281adce0 con 0x5625910b1a00 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f91281af150 con 0x5625910b2320 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91281ae3b0 con 0x5625910adf90 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.654+0000 7f9130246740 10 client.0 _ll_register_callbacks cb 0x7f911000bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48464/0 (socket says 172.21.15.100:48464) 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 -- 172.21.15.100:0/2979429613 learned_addr learned my addr 172.21.15.100:0/2979429613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9127fff640 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b2320 0x562591138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f91277fe640 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910adf90 0x5625910c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 -- 172.21.15.100:0/2979429613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910adf90 msgr2=0x5625910c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910adf90 0x5625910c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 -- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b2320 msgr2=0x562591138b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b2320 0x562591138b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 -- 172.21.15.100:0/2979429613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562591139190 con 0x5625910b1a00 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f911ffff640 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910c1310 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9110012e30 tx=0x7f911001b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549af795417e6f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9106ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9106ffd640 1 -- 172.21.15.100:0/2979429613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110035060 con 0x5625910b1a00 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9106ffd640 1 -- 172.21.15.100:0/2979429613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f911001bd30 con 0x5625910b1a00 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9120019040 con 0x5625910b1a00 2024-09-12T02:08:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9106ffd640 1 -- 172.21.15.100:0/2979429613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9110011d70 con 0x5625910b1a00 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9130246740 10 client.15735 fetch_fsmap learned FSMap version 26 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.655+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562591140540 con 0x5625910b1a00 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9106ffd640 1 -- 172.21.15.100:0/2979429613 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9120019040 con 0x5625910b1a00 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9106ffd640 1 -- 172.21.15.100:0/2979429613 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9110030790 con 0x5625910b1a00 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9130246740 10 client.15735 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9130246740 10 client.15735 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9130246740 20 client.15735 populate_metadata read hostname 'smithi100' 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9130246740 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910bcbe0 0x562591142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9130246740 4 client.15735 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x562590f9a1e0 con 0x5625910bcbe0 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f91277fe640 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910bcbe0 0x562591142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f9106ffd640 10 client.15735 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.656+0000 7f91277fe640 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910bcbe0 0x562591142d60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af9376933650c42 server_cookie=a38541b2f5264baa in_seq=0 out_seq=0 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9106ffd640 1 -- 172.21.15.100:0/2979429613 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x562590f9a1e0 con 0x5625910bcbe0 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9106ffd640 10 client.15735 handle_command_reply: tid=0 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 client.15735 shutdown 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 msgr2=0x5625910c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910c1310 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9110012e30 tx=0x7f911001b780 comp rx=0 tx=0).stop 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 shutdown_connections 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5625910bcbe0 0x562591142d60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5625910b2320 0x562591138b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9106ffd640 0 client.15735 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625910b1a00 0x5625910c1310 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 --2- 172.21.15.100:0/2979429613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625910adf90 0x5625910c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 >> 172.21.15.100:0/2979429613 conn(0x5625910b9e70 msgr2=0x5625910b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 shutdown_connections 2024-09-12T02:08:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 1 -- 172.21.15.100:0/2979429613 wait complete. 2024-09-12T02:08:37.702 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:08:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 26, 2024-09-12T02:08:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "leader": 24452, 2024-09-12T02:08:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "set_version": 4, 2024-09-12T02:08:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "sets": {} 2024-09-12T02:08:37.702 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f9130246740 20 client.15735 trim_cache size 0 max 16384 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f91140a2b80 msgr2=0x7f91140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f91140a2b80 0x7f91140a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5625910af310 tx=0x7f912000a790 comp rx=0 tx=0).stop 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 msgr2=0x7f91280744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91280744f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9118006010 tx=0x7f91180042f0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 shutdown_connections 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f91140a2b80 0x7f91140a5040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9128106f10 0x7f9128074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.657+0000 7f912de6d640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9128102790 0x7f9128074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.658+0000 7f912de6d640 1 --2- 172.21.15.100:0/3628019013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9128101de0 0x7f91280744f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.658+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 >> 172.21.15.100:0/3628019013 conn(0x7f91280fd8c0 msgr2=0x7f91280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.658+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 shutdown_connections 2024-09-12T02:08:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:08:37.658+0000 7f912de6d640 1 -- 172.21.15.100:0/3628019013 wait complete. 2024-09-12T02:08:38.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:38 smithi100 ceph-mon[31179]: scrub summary: idle 2024-09-12T02:08:38.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:38 smithi189 ceph-mon[35188]: scrub summary: idle 2024-09-12T02:08:38.609 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T02:08:38.609 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-12T02:08:38.621 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:08:38.630 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T02:08:38.641 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T02:08:38.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:38 smithi117 ceph-mon[35240]: scrub summary: idle 2024-09-12T02:08:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:39 smithi100 ceph-mon[31179]: pgmap v380: 97 pgs: 97 active+clean; 50 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 1.1 MiB/s wr, 474 op/s 2024-09-12T02:08:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:39 smithi189 ceph-mon[35188]: pgmap v380: 97 pgs: 97 active+clean; 50 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 1.1 MiB/s wr, 474 op/s 2024-09-12T02:08:39.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:39 smithi117 ceph-mon[35240]: pgmap v380: 97 pgs: 97 active+clean; 50 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 1.1 MiB/s wr, 474 op/s 2024-09-12T02:08:40.530 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:40 smithi100 ceph-mon[31179]: pgmap v381: 97 pgs: 97 active+clean; 9.5 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 920 KiB/s wr, 418 op/s 2024-09-12T02:08:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:40 smithi189 ceph-mon[35188]: pgmap v381: 97 pgs: 97 active+clean; 9.5 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 920 KiB/s wr, 418 op/s 2024-09-12T02:08:40.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:40 smithi117 ceph-mon[35240]: pgmap v381: 97 pgs: 97 active+clean; 9.5 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 920 KiB/s wr, 418 op/s 2024-09-12T02:08:43.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:43 smithi117 ceph-mon[35240]: pgmap v382: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 704 KiB/s wr, 302 op/s 2024-09-12T02:08:43.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:43 smithi100 ceph-mon[31179]: pgmap v382: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 704 KiB/s wr, 302 op/s 2024-09-12T02:08:43.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:43 smithi189 ceph-mon[35188]: pgmap v382: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 704 KiB/s wr, 302 op/s 2024-09-12T02:08:45.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:45 smithi117 ceph-mon[35240]: pgmap v383: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 426 KiB/s wr, 207 op/s 2024-09-12T02:08:45.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:45 smithi100 ceph-mon[31179]: pgmap v383: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 426 KiB/s wr, 207 op/s 2024-09-12T02:08:45.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:45 smithi189 ceph-mon[35188]: pgmap v383: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 426 KiB/s wr, 207 op/s 2024-09-12T02:08:47.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:47 smithi117 ceph-mon[35240]: pgmap v384: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s rd, 385 KiB/s wr, 183 op/s 2024-09-12T02:08:47.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:47 smithi100 ceph-mon[31179]: pgmap v384: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s rd, 385 KiB/s wr, 183 op/s 2024-09-12T02:08:47.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:47 smithi189 ceph-mon[35188]: pgmap v384: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s rd, 385 KiB/s wr, 183 op/s 2024-09-12T02:08:49.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:49 smithi117 ceph-mon[35240]: pgmap v385: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 99 KiB/s wr, 62 op/s 2024-09-12T02:08:49.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:49 smithi100 ceph-mon[31179]: pgmap v385: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 99 KiB/s wr, 62 op/s 2024-09-12T02:08:49.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:49 smithi189 ceph-mon[35188]: pgmap v385: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 99 KiB/s wr, 62 op/s 2024-09-12T02:08:51.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:51 smithi117 ceph-mon[35240]: pgmap v386: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 KiB/s wr, 29 op/s 2024-09-12T02:08:51.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:51 smithi100 ceph-mon[31179]: pgmap v386: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 KiB/s wr, 29 op/s 2024-09-12T02:08:51.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:51 smithi189 ceph-mon[35188]: pgmap v386: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 KiB/s wr, 29 op/s 2024-09-12T02:08:53.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:53 smithi117 ceph-mon[35240]: pgmap v387: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-12T02:08:53.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:53 smithi100 ceph-mon[31179]: pgmap v387: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-12T02:08:53.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:53 smithi189 ceph-mon[35188]: pgmap v387: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-12T02:08:55.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:55 smithi117 ceph-mon[35240]: pgmap v388: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T02:08:55.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:55 smithi100 ceph-mon[31179]: pgmap v388: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T02:08:55.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:55 smithi189 ceph-mon[35188]: pgmap v388: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T02:08:57.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:57 smithi117 ceph-mon[35240]: pgmap v389: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:08:57.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:57 smithi100 ceph-mon[31179]: pgmap v389: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:08:57.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:57 smithi189 ceph-mon[35188]: pgmap v389: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:08:59.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:08:59 smithi117 ceph-mon[35240]: pgmap v390: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:08:59.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:08:59 smithi100 ceph-mon[31179]: pgmap v390: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:08:59.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:08:59 smithi189 ceph-mon[35188]: pgmap v390: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:00.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:09:00.550 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 -- 172.21.15.100:0/3945729812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 msgr2=0x7f350410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 --2- 172.21.15.100:0/3945729812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350410eaf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009cd0 tx=0x7f34fc02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 -- 172.21.15.100:0/3945729812 shutdown_connections 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 --2- 172.21.15.100:0/3945729812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350410eaf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 --2- 172.21.15.100:0/3945729812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3504100d00 0x7f3504106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 --2- 172.21.15.100:0/3945729812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3504100350 0x7f3504100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 -- 172.21.15.100:0/3945729812 >> 172.21.15.100:0/3945729812 conn(0x7f3504077210 msgr2=0x7f35040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 -- 172.21.15.100:0/3945729812 shutdown_connections 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.057+0000 7f3508f58640 1 -- 172.21.15.100:0/3945729812 wait complete. 2024-09-12T02:09:01.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 Processor -- start 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 -- start start 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3504100350 0x7f3504198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3504100d00 0x7f3504198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3504111fa0 con 0x7f3504106f50 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3504111e20 con 0x7f3504100350 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.058+0000 7f3508f58640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3504112120 con 0x7f3504100d00 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54612/0 (socket says 172.21.15.100:54612) 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 -- 172.21.15.100:0/1195564384 learned_addr learned my addr 172.21.15.100:0/1195564384 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f350259c640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3504100350 0x7f3504198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3504100d00 0x7f3504198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 -- 172.21.15.100:0/1195564384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3504100d00 msgr2=0x7f3504198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3504100d00 0x7f3504198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 -- 172.21.15.100:0/1195564384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3504100350 msgr2=0x7f3504198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3504100350 0x7f3504198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 -- 172.21.15.100:0/1195564384 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350419d3d0 con 0x7f3504106f50 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3504100d00 0x7f3504198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3502d9d640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350419ccf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f34fc006010 tx=0x7f34fc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f34f37fe640 1 -- 172.21.15.100:0/1195564384 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc004450 con 0x7f3504106f50 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f34f37fe640 1 -- 172.21.15.100:0/1195564384 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34fc003e10 con 0x7f3504106f50 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350419d660 con 0x7f3504106f50 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f34f37fe640 1 -- 172.21.15.100:0/1195564384 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0466e0 con 0x7f3504106f50 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.059+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35041a4fa0 con 0x7f3504106f50 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f34f37fe640 1 -- 172.21.15.100:0/1195564384 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f34fc0305a0 con 0x7f3504106f50 2024-09-12T02:09:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 Processor -- start 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 -- start start 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d6441880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d644c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d644ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5613d63a72e0 con 0x5613d644c680 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5613d634ece0 con 0x5613d64414a0 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f350b331740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5613d63a32a0 con 0x5613d6441dc0 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f34f37fe640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f34ec0a2b80 0x7f34ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d644ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d644ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54618/0 (socket says 172.21.15.100:54618) 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.062+0000 7f3501d9b640 1 -- 172.21.15.100:0/1484276431 learned_addr learned my addr 172.21.15.100:0/1484276431 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:01.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d6441880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f350259c640 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d644c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3502d9d640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f34ec0a2b80 0x7f34ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f34f37fe640 1 -- 172.21.15.100:0/1195564384 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f34fc02e030 con 0x7f3504106f50 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3501d9b640 1 -- 172.21.15.100:0/1484276431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 msgr2=0x5613d644c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d644c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3501d9b640 1 -- 172.21.15.100:0/1484276431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 msgr2=0x5613d6441880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d6441880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3501d9b640 1 -- 172.21.15.100:0/1484276431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613d6333440 con 0x5613d644c680 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d644ea70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f34f8012830 tx=0x7f34f8008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5a7ff755a7747d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f3502d9d640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f34ec0a2b80 0x7f34ec0a5040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0bd200 tx=0x7f34fc0e7e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f34f0ff9640 1 -- 172.21.15.100:0/1484276431 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f800cae0 con 0x5613d644c680 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f34f0ff9640 1 -- 172.21.15.100:0/1484276431 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f8005500 con 0x5613d644c680 2024-09-12T02:09:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.063+0000 7f34f0ff9640 1 -- 172.21.15.100:0/1484276431 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8004c80 con 0x5613d644c680 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 -- 172.21.15.100:0/1484276431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 msgr2=0x5613d644ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d644ea70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f34f8012830 tx=0x7f34f8008f90 comp rx=0 tx=0).stop 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 -- 172.21.15.100:0/1484276431 shutdown_connections 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d644ea70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d644c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 --2- 172.21.15.100:0/1484276431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d6441880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 -- 172.21.15.100:0/1484276431 >> 172.21.15.100:0/1484276431 conn(0x5613d643da30 msgr2=0x5613d643de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 -- 172.21.15.100:0/1484276431 shutdown_connections 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 -- 172.21.15.100:0/1484276431 wait complete. 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 -- start start 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.064+0000 7f350b331740 1 Processor -- start 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d644c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d64492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d6449830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5613d644f250 con 0x5613d644c680 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5613d6362050 con 0x5613d64414a0 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5613d644f3d0 con 0x5613d6441dc0 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 10 client.0 _ll_register_callbacks cb 0x5613d63a2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d6449830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d6449830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54622/0 (socket says 172.21.15.100:54622) 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 -- 172.21.15.100:0/1155709506 learned_addr learned my addr 172.21.15.100:0/1155709506 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d644c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350259c640 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d64492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 -- 172.21.15.100:0/1155709506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 msgr2=0x5613d64492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d64492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 -- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 msgr2=0x5613d644c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d644c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 -- 172.21.15.100:0/1155709506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613d61183c0 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d6449830 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f34f8012670 tx=0x7f34f8004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73432511ad626a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f34e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1155709506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8004c60 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1155709506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f34f8004e00 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f8005500 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1155709506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f34f800c8e0 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.065+0000 7f350b331740 10 client.15747 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5613d645ac50 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1155709506 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f8005500 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1155709506 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f34f8020ad0 con 0x5613d644c680 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350b331740 10 client.15747 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350b331740 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:09:01.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350b331740 20 client.15747 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350b331740 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d645c0b0 0x5613d645e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350b331740 4 client.15747 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613d63b4850 con 0x5613d645c0b0 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.066+0000 7f350259c640 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d645c0b0 0x5613d645e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350259c640 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d645c0b0 0x5613d645e4a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43daff642dff4b1b server_cookie=797b3eb9aebb149f in_seq=0 out_seq=0 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f34e9ffb640 10 client.15747 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1155709506 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613d63b4850 con 0x5613d645c0b0 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f34e9ffb640 10 client.15747 handle_command_reply: tid=0 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 client.15747 shutdown 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 msgr2=0x5613d6449830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d6449830 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f34f8012670 tx=0x7f34f8004980 comp rx=0 tx=0).stop 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 shutdown_connections 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d645c0b0 0x5613d645e4a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d644c680 0x5613d6449830 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d6441dc0 0x5613d64492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 --2- 172.21.15.100:0/1155709506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d644c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f34e9ffb640 0 client.15747 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:01.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 >> 172.21.15.100:0/1155709506 conn(0x5613d643da30 msgr2=0x5613d6443710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:01.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 shutdown_connections 2024-09-12T02:09:01.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.067+0000 7f350b331740 1 -- 172.21.15.100:0/1155709506 wait complete. 2024-09-12T02:09:01.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.068+0000 7f350b331740 20 client.15747 trim_cache size 0 max 16384 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.084+0000 7f350b331740 1 Processor -- start 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350b331740 1 -- start start 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350b331740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d64584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350b331740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d6441dc0 0x5613d6463c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350b331740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d6464150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350b331740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f35041afd50 con 0x5613d6441dc0 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350b331740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ad5f0 con 0x5613d64414a0 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350b331740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ab440 con 0x5613d644c680 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d6441dc0 0x5613d6463c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d6441dc0 0x5613d6463c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54638/0 (socket says 172.21.15.100:54638) 2024-09-12T02:09:01.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 -- 172.21.15.100:0/2863313269 learned_addr learned my addr 172.21.15.100:0/2863313269 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f3501d9b640 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d6464150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 -- 172.21.15.100:0/2863313269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 msgr2=0x5613d6464150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d6464150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 -- 172.21.15.100:0/2863313269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 msgr2=0x5613d64584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d64584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 -- 172.21.15.100:0/2863313269 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613d644c370 con 0x5613d6441dc0 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f3501d9b640 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d6464150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f350259c640 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d6441dc0 0x5613d6463c10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5613d643e890 tx=0x7f34f4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d3edc7edf2d976 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.085+0000 7f34ebfff640 1 -- 172.21.15.100:0/2863313269 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4005220 con 0x5613d6441dc0 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f34ebfff640 1 -- 172.21.15.100:0/2863313269 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f4004c80 con 0x5613d6441dc0 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f34ebfff640 1 -- 172.21.15.100:0/2863313269 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f401ea40 con 0x5613d6441dc0 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 -- 172.21.15.100:0/2863313269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d6441dc0 msgr2=0x5613d6463c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d6441dc0 0x5613d6463c10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5613d643e890 tx=0x7f34f4010800 comp rx=0 tx=0).stop 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 -- 172.21.15.100:0/2863313269 shutdown_connections 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d6464150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d6441dc0 0x5613d6463c10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 --2- 172.21.15.100:0/2863313269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d64414a0 0x5613d64584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 -- 172.21.15.100:0/2863313269 >> 172.21.15.100:0/2863313269 conn(0x5613d643da30 msgr2=0x5613d64483a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 -- 172.21.15.100:0/2863313269 shutdown_connections 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.086+0000 7f350b331740 1 -- 172.21.15.100:0/2863313269 wait complete. 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 -- start start 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 Processor -- start 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d64414a0 0x5613d6454c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d6441dc0 0x5613d644ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d64504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f35041abab0 con 0x5613d64414a0 2024-09-12T02:09:01.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35041acf20 con 0x5613d6441dc0 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ac180 con 0x5613d644c680 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350b331740 10 client.0 _ll_register_callbacks cb 0x7f34f8008dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d64414a0 0x5613d6454c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d64414a0 0x5613d6454c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54654/0 (socket says 172.21.15.100:54654) 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 -- 172.21.15.100:0/1410570781 learned_addr learned my addr 172.21.15.100:0/1410570781 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f350259c640 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d6441dc0 0x5613d644ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d64504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 -- 172.21.15.100:0/1410570781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 msgr2=0x5613d64504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d64504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 -- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d6441dc0 msgr2=0x5613d644ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d6441dc0 0x5613d644ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.087+0000 7f3501d9b640 1 -- 172.21.15.100:0/1410570781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613d6450be0 con 0x5613d64414a0 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f3501d9b640 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d64414a0 0x5613d6454c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f34f800f490 tx=0x7f34f8008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bcdbdde51da036 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:01.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f34e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1410570781 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f800ca80 con 0x5613d64414a0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1410570781 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f34f800cc20 con 0x5613d64414a0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f4004c80 con 0x5613d64414a0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1410570781 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f34f800ce20 con 0x5613d64414a0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 10 client.15753 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5613d64c6a40 con 0x5613d64414a0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1410570781 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34f4004c80 con 0x5613d64414a0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1410570781 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f34f8004040 con 0x5613d64414a0 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 10 client.15753 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 20 client.15753 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d64c7040 0x5613d64c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 4 client.15753 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:09:01.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.088+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613d63aed60 con 0x5613d64c7040 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350259c640 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d64c7040 0x5613d64c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350259c640 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d64c7040 0x5613d64c9430 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d71ea012dac76ba4 server_cookie=6c291512c9aa4609 in_seq=0 out_seq=0 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f34e9ffb640 10 client.15753 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f34e9ffb640 1 -- 172.21.15.100:0/1410570781 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5613d63aed60 con 0x5613d64c7040 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f34e9ffb640 10 client.15753 handle_command_reply: tid=0 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 client.15753 shutdown 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d64414a0 msgr2=0x5613d6454c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d64414a0 0x5613d6454c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f34f800f490 tx=0x7f34f8008f90 comp rx=0 tx=0).stop 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 shutdown_connections 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5613d64c7040 0x5613d64c9430 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613d644c680 0x5613d64504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613d6441dc0 0x5613d644ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f34e9ffb640 0 client.15753 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:01.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 --2- 172.21.15.100:0/1410570781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613d64414a0 0x5613d6454c80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.089+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 >> 172.21.15.100:0/1410570781 conn(0x5613d643da30 msgr2=0x5613d644ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 shutdown_connections 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f350b331740 1 -- 172.21.15.100:0/1410570781 wait complete. 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f350b331740 20 client.15753 trim_cache size 0 max 16384 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-09-12T02:09:01.097 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f34ec0a2b80 msgr2=0x7f34ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f34ec0a2b80 0x7f34ec0a5040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0bd200 tx=0x7f34fc0e7e00 comp rx=0 tx=0).stop 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 msgr2=0x7f350419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350419ccf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f34fc006010 tx=0x7f34fc003c20 comp rx=0 tx=0).stop 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 shutdown_connections 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f34ec0a2b80 0x7f34ec0a5040 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3504106f50 0x7f350419ccf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3504100d00 0x7f3504198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 --2- 172.21.15.100:0/1195564384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3504100350 0x7f3504198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:01.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 >> 172.21.15.100:0/1195564384 conn(0x7f3504077210 msgr2=0x7f35041056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:01.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 shutdown_connections 2024-09-12T02:09:01.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:01.090+0000 7f3508f58640 1 -- 172.21.15.100:0/1195564384 wait complete. 2024-09-12T02:09:01.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:01 smithi100 ceph-mon[31179]: pgmap v391: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:01.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:01 smithi189 ceph-mon[35188]: pgmap v391: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:01.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:01 smithi117 ceph-mon[35240]: pgmap v391: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:01.809 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:09:01.810 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:09:02.057 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:02.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 -- 172.21.15.100:0/2989243262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec102780 msgr2=0x7f72ec1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:02.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 --2- 172.21.15.100:0/2989243262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec102780 0x7f72ec1067d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009900 tx=0x7f72d802a410 comp rx=0 tx=0).stop 2024-09-12T02:09:02.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 -- 172.21.15.100:0/2989243262 shutdown_connections 2024-09-12T02:09:02.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 --2- 172.21.15.100:0/2989243262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72ec106f00 0x7f72ec10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 --2- 172.21.15.100:0/2989243262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec102780 0x7f72ec1067d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 --2- 172.21.15.100:0/2989243262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72ec101dd0 0x7f72ec1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 -- 172.21.15.100:0/2989243262 >> 172.21.15.100:0/2989243262 conn(0x7f72ec0fd8b0 msgr2=0x7f72ec0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 -- 172.21.15.100:0/2989243262 shutdown_connections 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.538+0000 7f72f2b54640 1 -- 172.21.15.100:0/2989243262 wait complete. 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 Processor -- start 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 -- start start 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec101dd0 0x7f72ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72ec102780 0x7f72ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72ec106f00 0x7f72ec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec111f60 con 0x7f72ec101dd0 2024-09-12T02:09:02.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec111de0 con 0x7f72ec102780 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f2b54640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec1120e0 con 0x7f72ec106f00 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec101dd0 0x7f72ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec101dd0 0x7f72ec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54666/0 (socket says 172.21.15.100:54666) 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 -- 172.21.15.100:0/689361127 learned_addr learned my addr 172.21.15.100:0/689361127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 -- 172.21.15.100:0/689361127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72ec106f00 msgr2=0x7f72ec074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f10f1640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72ec106f00 0x7f72ec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72ebfff640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72ec102780 0x7f72ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72ec106f00 0x7f72ec074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 -- 172.21.15.100:0/689361127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72ec102780 msgr2=0x7f72ec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72ec102780 0x7f72ec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 -- 172.21.15.100:0/689361127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec1a6880 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f10f1640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72ec106f00 0x7f72ec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72ebfff640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72ec102780 0x7f72ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.539+0000 7f72f08f0640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec101dd0 0x7f72ec0744f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c890 tx=0x7f72e000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.540+0000 7f72e9ffb640 1 -- 172.21.15.100:0/689361127 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0004220 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.540+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ec1a6b70 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.540+0000 7f72e9ffb640 1 -- 172.21.15.100:0/689361127 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72e00043c0 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.540+0000 7f72e9ffb640 1 -- 172.21.15.100:0/689361127 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e001d060 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.540+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ec1a7100 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.541+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec1021b0 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.542+0000 7f72e9ffb640 1 -- 172.21.15.100:0/689361127 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f72e00079b0 con 0x7f72ec101dd0 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.542+0000 7f72e9ffb640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72dc0a2b80 0x7f72dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:02.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.543+0000 7f72e9ffb640 1 -- 172.21.15.100:0/689361127 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f72e00cedb0 con 0x7f72ec101dd0 2024-09-12T02:09:02.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.543+0000 7f72ebfff640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72dc0a2b80 0x7f72dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:02.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.543+0000 7f72ebfff640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72dc0a2b80 0x7f72dc0a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000c00 tx=0x7f72d8032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:02.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.547+0000 7f72e9ffb640 1 -- 172.21.15.100:0/689361127 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72e0014030 con 0x7f72ec101dd0 2024-09-12T02:09:02.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.747+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72ec075a20 con 0x7f72ec101dd0 2024-09-12T02:09:02.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.748+0000 7f72e9ffb640 1 -- 172.21.15.100:0/689361127 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11931 (secure 0 0 0) 0x7f72e009bd20 con 0x7f72ec101dd0 2024-09-12T02:09:02.748 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:09:02.749 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:08:26:210418+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:08:25.469043+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:09:02.749 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72dc0a2b80 msgr2=0x7f72dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72dc0a2b80 0x7f72dc0a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000c00 tx=0x7f72d8032d50 comp rx=0 tx=0).stop 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec101dd0 msgr2=0x7f72ec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec101dd0 0x7f72ec0744f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c890 tx=0x7f72e000cd50 comp rx=0 tx=0).stop 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 shutdown_connections 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f72dc0a2b80 0x7f72dc0a5040 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72ec106f00 0x7f72ec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72ec102780 0x7f72ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 --2- 172.21.15.100:0/689361127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ec101dd0 0x7f72ec0744f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:02.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 >> 172.21.15.100:0/689361127 conn(0x7f72ec0fd8b0 msgr2=0x7f72ec0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:02.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 shutdown_connections 2024-09-12T02:09:02.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:02.750+0000 7f72f2b54640 1 -- 172.21.15.100:0/689361127 wait complete. 2024-09-12T02:09:03.405 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:03 smithi100 ceph-mon[31179]: pgmap v392: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-12T02:09:03.406 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:03 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/689361127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:03.434 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:09:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:03 smithi189 ceph-mon[35188]: pgmap v392: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-12T02:09:03.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:03 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/689361127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:03.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:03 smithi117 ceph-mon[35240]: pgmap v392: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-12T02:09:03.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:03 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/689361127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:03.680 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 -- 172.21.15.100:0/532981751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f01011c0 msgr2=0x7f12f0101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 --2- 172.21.15.100:0/532981751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f01011c0 0x7f12f0101620 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009900 tx=0x7f12ec02a410 comp rx=0 tx=0).stop 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 -- 172.21.15.100:0/532981751 shutdown_connections 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 --2- 172.21.15.100:0/532981751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12f0101b60 0x7f12f010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 --2- 172.21.15.100:0/532981751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f01011c0 0x7f12f0101620 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 --2- 172.21.15.100:0/532981751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12f0105ad0 0x7f12f0105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 -- 172.21.15.100:0/532981751 >> 172.21.15.100:0/532981751 conn(0x7f12f0077210 msgr2=0x7f12f00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 -- 172.21.15.100:0/532981751 shutdown_connections 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.157+0000 7f12f87b9640 1 -- 172.21.15.100:0/532981751 wait complete. 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 Processor -- start 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 -- start start 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12f01011c0 0x7f12f01974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12f0101b60 0x7f12f0197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f0105ad0 0x7f12f019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0110fc0 con 0x7f12f0105ad0 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0110e40 con 0x7f12f01011c0 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.158+0000 7f12f87b9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0111140 con 0x7f12f0101b60 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f0105ad0 0x7f12f019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f0105ad0 0x7f12f019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35148/0 (socket says 172.21.15.100:35148) 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 -- 172.21.15.100:0/2431756275 learned_addr learned my addr 172.21.15.100:0/2431756275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12f0101b60 0x7f12f0197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6555640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12f01011c0 0x7f12f01974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 -- 172.21.15.100:0/2431756275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12f0101b60 msgr2=0x7f12f0197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12f0101b60 0x7f12f0197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 -- 172.21.15.100:0/2431756275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12f01011c0 msgr2=0x7f12f01974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12f01011c0 0x7f12f01974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 -- 172.21.15.100:0/2431756275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f019c470 con 0x7f12f0105ad0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f6d56640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f0105ad0 0x7f12f019bd90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f12e800db90 tx=0x7f12e800df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12e37fe640 1 -- 172.21.15.100:0/2431756275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e800e880 con 0x7f12f0105ad0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12e37fe640 1 -- 172.21.15.100:0/2431756275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e8009550 con 0x7f12f0105ad0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f019c700 con 0x7f12f0105ad0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12e37fe640 1 -- 172.21.15.100:0/2431756275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8016630 con 0x7f12f0105ad0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.159+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f01000b0 con 0x7f12f0105ad0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12e37fe640 1 -- 172.21.15.100:0/2431756275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f12e8009700 con 0x7f12f0105ad0 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 Processor -- start 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 -- start start 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x56236920b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x56236920ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369218760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5623691712f0 con 0x56236920b5d0 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562369118cf0 con 0x56236920cb40 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12fab92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56236916d2b0 con 0x562369216370 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12f6555640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x56236920ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12f6555640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x56236920ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35156/0 (socket says 172.21.15.100:35156) 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12e37fe640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f12dc0a2c00 0x7f12dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.162+0000 7f12f6555640 1 -- 172.21.15.100:0/2692731938 learned_addr learned my addr 172.21.15.100:0/2692731938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x56236920b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6d56640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f12dc0a2c00 0x7f12dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369218760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12e37fe640 1 -- 172.21.15.100:0/2431756275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12e80d0580 con 0x7f12f0105ad0 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6555640 1 -- 172.21.15.100:0/2692731938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 msgr2=0x562369218760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6555640 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369218760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6555640 1 -- 172.21.15.100:0/2692731938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 msgr2=0x56236920b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6555640 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x56236920b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6555640 1 -- 172.21.15.100:0/2692731938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623690fd3a0 con 0x56236920b5d0 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369218760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6555640 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x56236920ba10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009a70 tx=0x7f12e4009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1a12d763302268 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12e0ff9640 1 -- 172.21.15.100:0/2692731938 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4017070 con 0x56236920b5d0 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12f6d56640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f12dc0a2c00 0x7f12dc0a50c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f12e80997c0 tx=0x7f12e80922d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12e0ff9640 1 -- 172.21.15.100:0/2692731938 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e4013470 con 0x56236920b5d0 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.163+0000 7f12e0ff9640 1 -- 172.21.15.100:0/2692731938 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4012630 con 0x56236920b5d0 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 -- 172.21.15.100:0/2692731938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 msgr2=0x56236920ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x56236920ba10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009a70 tx=0x7f12e4009f30 comp rx=0 tx=0).stop 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 -- 172.21.15.100:0/2692731938 shutdown_connections 2024-09-12T02:09:04.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369218760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x56236920ba10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 --2- 172.21.15.100:0/2692731938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x56236920b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 -- 172.21.15.100:0/2692731938 >> 172.21.15.100:0/2692731938 conn(0x5623691d4310 msgr2=0x562369207c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 -- 172.21.15.100:0/2692731938 shutdown_connections 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 -- 172.21.15.100:0/2692731938 wait complete. 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.164+0000 7f12fab92740 1 -- start start 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 1 Processor -- start 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369215d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x562369212fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369213530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562369219070 con 0x56236920b5d0 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56236912c060 con 0x56236920cb40 2024-09-12T02:09:04.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5623692191f0 con 0x562369216370 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12fab92740 10 client.0 _ll_register_callbacks cb 0x562368e7f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369215d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369215d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35160/0 (socket says 172.21.15.100:35160) 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 -- 172.21.15.100:0/2284309072 learned_addr learned my addr 172.21.15.100:0/2284309072 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 -- 172.21.15.100:0/2284309072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 msgr2=0x562369213530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369213530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 -- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 msgr2=0x562369212fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f6555640 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x562369212fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x562369212fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 -- 172.21.15.100:0/2284309072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562368ee23c0 con 0x56236920b5d0 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f6555640 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x562369212fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369215d00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009230 tx=0x7f12ec003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111d89218fb61b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:04.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.165+0000 7f12d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2284309072 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec035040 con 0x56236920b5d0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2284309072 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12ec003da0 con 0x56236920b5d0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e4013470 con 0x56236920b5d0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2284309072 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f12ec005020 con 0x56236920b5d0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 10 client.15771 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562369224a60 con 0x56236920b5d0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2284309072 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e4013470 con 0x56236920b5d0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2284309072 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f12ec031540 con 0x56236920b5d0 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 10 client.15771 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 10 client.15771 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 20 client.15771 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369228380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 4 client.15771 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56236917e860 con 0x562369225f20 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.166+0000 7f12f6555640 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369228380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.167+0000 7f12f6555640 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369228380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33c2cf2626510b60 server_cookie=c6cfdaa3d4fa3a2e in_seq=0 out_seq=0 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.167+0000 7f12d9ffb640 10 client.15771 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2284309072 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56236917e860 con 0x562369225f20 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12d9ffb640 10 client.15771 handle_command_reply: tid=0 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 client.15771 shutdown 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 msgr2=0x562369215d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369215d00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009230 tx=0x7f12ec003820 comp rx=0 tx=0).stop 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 shutdown_connections 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369228380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12d9ffb640 0 client.15771 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369213530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x562369212fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 --2- 172.21.15.100:0/2284309072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369215d00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 >> 172.21.15.100:0/2284309072 conn(0x5623691d4310 msgr2=0x56236920d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:04.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 shutdown_connections 2024-09-12T02:09:04.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 1 -- 172.21.15.100:0/2284309072 wait complete. 2024-09-12T02:09:04.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.168+0000 7f12fab92740 20 client.15771 trim_cache size 0 max 16384 2024-09-12T02:09:04.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 Processor -- start 2024-09-12T02:09:04.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 -- start start 2024-09-12T02:09:04.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369222310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x56236920c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369207700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01adca0 con 0x56236920b5d0 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01ab540 con 0x56236920cb40 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12fab92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01a9390 con 0x562369216370 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369222310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369222310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35174/0 (socket says 172.21.15.100:35174) 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 -- 172.21.15.100:0/1783241895 learned_addr learned my addr 172.21.15.100:0/1783241895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 -- 172.21.15.100:0/1783241895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 msgr2=0x562369207700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 --2- 172.21.15.100:0/1783241895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369207700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 -- 172.21.15.100:0/1783241895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 msgr2=0x56236920c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 --2- 172.21.15.100:0/1783241895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x56236920c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.181+0000 7f12f5d54640 1 -- 172.21.15.100:0/1783241895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56236920b2d0 con 0x56236920b5d0 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12f5d54640 1 --2- 172.21.15.100:0/1783241895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369222310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009850 tx=0x7f12ec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b865772d395385fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:04.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12dbfff640 1 -- 172.21.15.100:0/1783241895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec035070 con 0x56236920b5d0 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12dbfff640 1 -- 172.21.15.100:0/1783241895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12ec031740 con 0x56236920b5d0 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12dbfff640 1 -- 172.21.15.100:0/1783241895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0047a0 con 0x56236920b5d0 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12fab92740 1 -- 172.21.15.100:0/1783241895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 msgr2=0x562369222310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12fab92740 1 --2- 172.21.15.100:0/1783241895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369222310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009850 tx=0x7f12ec009260 comp rx=0 tx=0).stop 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12fab92740 1 -- 172.21.15.100:0/1783241895 shutdown_connections 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12fab92740 1 --2- 172.21.15.100:0/1783241895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369207700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12fab92740 1 --2- 172.21.15.100:0/1783241895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920cb40 0x56236920c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12fab92740 1 --2- 172.21.15.100:0/1783241895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920b5d0 0x562369222310 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.182+0000 7f12fab92740 1 -- 172.21.15.100:0/1783241895 >> 172.21.15.100:0/1783241895 conn(0x5623691d4310 msgr2=0x562369202a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 -- 172.21.15.100:0/1783241895 shutdown_connections 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 -- 172.21.15.100:0/1783241895 wait complete. 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 -- start start 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 Processor -- start 2024-09-12T02:09:04.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920b5d0 0x56236921e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920cb40 0x56236921ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369219db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01a9a00 con 0x56236920cb40 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01aae70 con 0x56236920b5d0 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01aa0d0 con 0x562369216370 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12fab92740 10 client.0 _ll_register_callbacks cb 0x7f12ec009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12f6555640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920cb40 0x56236921ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12f6555640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920cb40 0x56236921ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35178/0 (socket says 172.21.15.100:35178) 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12f6555640 1 -- 172.21.15.100:0/2768271309 learned_addr learned my addr 172.21.15.100:0/2768271309 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369219db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.183+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920b5d0 0x56236921e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12f6555640 1 -- 172.21.15.100:0/2768271309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 msgr2=0x562369219db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12f6555640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369219db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12f6555640 1 -- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920b5d0 msgr2=0x56236921e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12f6555640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920b5d0 0x56236921e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12f6555640 1 -- 172.21.15.100:0/2768271309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562369206310 con 0x56236920cb40 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920b5d0 0x56236921e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12f6555640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920cb40 0x56236921ed90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009a70 tx=0x7f12e4009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3325aa170f250b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2768271309 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4017040 con 0x56236920cb40 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2768271309 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12e4013680 con 0x56236920cb40 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12ec031740 con 0x56236920cb40 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2768271309 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f12e40138a0 con 0x56236920cb40 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 10 client.15777 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562369290690 con 0x56236920cb40 2024-09-12T02:09:04.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2768271309 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12ec031740 con 0x56236920cb40 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2768271309 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f12e4026410 con 0x56236920cb40 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 10 client.15777 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 10 client.15777 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 20 client.15777 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369292b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 4 client.15777 mds_command: new command op to 24428 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.184+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 --> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562369178d70 con 0x562369225f20 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369292b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12f5d54640 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369292b30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=144e57acf583357d server_cookie=c1c63c70f43e6145 in_seq=0 out_seq=0 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12d9ffb640 10 client.15777 ms_handle_connect on v2:172.21.15.117:6836/137176693 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12d9ffb640 1 -- 172.21.15.100:0/2768271309 <== mds.2 v2:172.21.15.117:6836/137176693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562369178d70 con 0x562369225f20 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12d9ffb640 10 client.15777 handle_command_reply: tid=0 2024-09-12T02:09:04.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 client.15777 shutdown 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920cb40 msgr2=0x56236921ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920cb40 0x56236921ed90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009a70 tx=0x7f12e4009180 comp rx=0 tx=0).stop 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 shutdown_connections 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:6836/137176693,v1:172.21.15.117:6837/137176693] conn(0x562369225f20 0x562369292b30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562369216370 0x562369219db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56236920cb40 0x56236921ed90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 --2- 172.21.15.100:0/2768271309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236920b5d0 0x56236921e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.185+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 >> 172.21.15.100:0/2768271309 conn(0x5623691d4310 msgr2=0x562369202a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12d9ffb640 0 client.15777 ms_handle_reset on v2:172.21.15.117:6836/137176693 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 shutdown_connections 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12fab92740 1 -- 172.21.15.100:0/2768271309 wait complete. 2024-09-12T02:09:04.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12fab92740 20 client.15777 trim_cache size 0 max 16384 2024-09-12T02:09:04.198 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f12dc0a2c00 msgr2=0x7f12dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f12dc0a2c00 0x7f12dc0a50c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f12e80997c0 tx=0x7f12e80922d0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f0105ad0 msgr2=0x7f12f019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f0105ad0 0x7f12f019bd90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f12e800db90 tx=0x7f12e800df90 comp rx=0 tx=0).stop 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 shutdown_connections 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f12dc0a2c00 0x7f12dc0a50c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12f0105ad0 0x7f12f019bd90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12f0101b60 0x7f12f0197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 --2- 172.21.15.100:0/2431756275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12f01011c0 0x7f12f01974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 >> 172.21.15.100:0/2431756275 conn(0x7f12f0077210 msgr2=0x7f12f0103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 shutdown_connections 2024-09-12T02:09:04.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:04.186+0000 7f12f87b9640 1 -- 172.21.15.100:0/2431756275 wait complete. 2024-09-12T02:09:04.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:09:05.131 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:05.451 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:05 smithi100 ceph-mon[31179]: pgmap v393: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-12T02:09:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.532+0000 7f4aa107e640 1 -- 172.21.15.100:0/269553876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c101420 msgr2=0x7f4a9c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.532+0000 7f4aa107e640 1 --2- 172.21.15.100:0/269553876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c101420 0x7f4a9c10d950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009930 tx=0x7f4a9402a420 comp rx=0 tx=0).stop 2024-09-12T02:09:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.532+0000 7f4aa107e640 1 -- 172.21.15.100:0/269553876 shutdown_connections 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.533+0000 7f4aa107e640 1 --2- 172.21.15.100:0/269553876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c101420 0x7f4a9c10d950 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.533+0000 7f4aa107e640 1 --2- 172.21.15.100:0/269553876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a9c100a80 0x7f4a9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.533+0000 7f4aa107e640 1 --2- 172.21.15.100:0/269553876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9c106a80 0x7f4a9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.533+0000 7f4aa107e640 1 -- 172.21.15.100:0/269553876 >> 172.21.15.100:0/269553876 conn(0x7f4a9c0fc7a0 msgr2=0x7f4a9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.533+0000 7f4aa107e640 1 -- 172.21.15.100:0/269553876 shutdown_connections 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.533+0000 7f4aa107e640 1 -- 172.21.15.100:0/269553876 wait complete. 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.533+0000 7f4aa107e640 1 Processor -- start 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4aa107e640 1 -- start start 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4aa107e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c100a80 0x7f4a9c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4aa107e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9c101420 0x7f4a9c199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4aa107e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a9c106a80 0x7f4a9c1a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4aa107e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c110e80 con 0x7f4a9c100a80 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4aa107e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c110d00 con 0x7f4a9c101420 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4aa107e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c111000 con 0x7f4a9c106a80 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c100a80 0x7f4a9c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c100a80 0x7f4a9c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35194/0 (socket says 172.21.15.100:35194) 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/1124104904 learned_addr learned my addr 172.21.15.100:0/1124104904 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9c101420 0x7f4a9c199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a9c106a80 0x7f4a9c1a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/1124104904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a9c106a80 msgr2=0x7f4a9c1a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a9c106a80 0x7f4a9c1a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/1124104904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9c101420 msgr2=0x7f4a9c199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9c101420 0x7f4a9c199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/1124104904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c1a47f0 con 0x7f4a9c100a80 2024-09-12T02:09:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.534+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9c101420 0x7f4a9c199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.535+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c100a80 0x7f4a9c199230 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00eab0 tx=0x7f4a8c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.535+0000 7f4a83fff640 1 -- 172.21.15.100:0/1124104904 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00ce40 con 0x7f4a9c100a80 2024-09-12T02:09:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.535+0000 7f4a83fff640 1 -- 172.21.15.100:0/1124104904 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a8c011950 con 0x7f4a9c100a80 2024-09-12T02:09:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.535+0000 7f4a83fff640 1 -- 172.21.15.100:0/1124104904 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c010ae0 con 0x7f4a9c100a80 2024-09-12T02:09:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.535+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c1a49c0 con 0x7f4a9c100a80 2024-09-12T02:09:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.535+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c1a4e80 con 0x7f4a9c100a80 2024-09-12T02:09:05.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4a83fff640 1 -- 172.21.15.100:0/1124104904 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4a8c011b00 con 0x7f4a9c100a80 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 Processor -- start 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 -- start start 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74becc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74becca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74bedb780 0x55a74beddb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a74be322f0 con 0x55a74bedb780 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a74bdd9cf0 con 0x55a74becdb40 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.538+0000 7f4aa3457740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a74be2e2b0 con 0x55a74becc5d0 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74bedb780 0x55a74beddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9ad9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74becca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74bedb780 0x55a74beddb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35202/0 (socket says 172.21.15.100:35202) 2024-09-12T02:09:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 -- 172.21.15.100:0/274660463 learned_addr learned my addr 172.21.15.100:0/274660463 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a83fff640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a840a2c00 0x7f4a840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74becc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 -- 172.21.15.100:0/274660463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 msgr2=0x55a74becca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a840a2c00 0x7f4a840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74becca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 -- 172.21.15.100:0/274660463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 msgr2=0x55a74becc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74becc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 -- 172.21.15.100:0/274660463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74bdbe3a0 con 0x55a74bedb780 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a83fff640 1 -- 172.21.15.100:0/1124104904 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a8c0cf6a0 con 0x7f4a9c100a80 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74bedb780 0x55a74beddb70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000bbe0 tx=0x7f4a9000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4a66d93e2586b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a817fa640 1 -- 172.21.15.100:0/274660463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90017620 con 0x55a74bedb780 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a840a2c00 0x7f4a840a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009900 tx=0x7f4a9402a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a817fa640 1 -- 172.21.15.100:0/274660463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a90017ca0 con 0x55a74bedb780 2024-09-12T02:09:05.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.539+0000 7f4a817fa640 1 -- 172.21.15.100:0/274660463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9000fd60 con 0x55a74bedb780 2024-09-12T02:09:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 -- 172.21.15.100:0/274660463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74bedb780 msgr2=0x55a74beddb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74bedb780 0x55a74beddb70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000bbe0 tx=0x7f4a9000d710 comp rx=0 tx=0).stop 2024-09-12T02:09:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 -- 172.21.15.100:0/274660463 shutdown_connections 2024-09-12T02:09:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74bedb780 0x55a74beddb70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74becca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 --2- 172.21.15.100:0/274660463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74becc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 -- 172.21.15.100:0/274660463 >> 172.21.15.100:0/274660463 conn(0x55a74be95310 msgr2=0x55a74bec8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 -- 172.21.15.100:0/274660463 shutdown_connections 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.540+0000 7f4aa3457740 1 -- 172.21.15.100:0/274660463 wait complete. 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 -- start start 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 Processor -- start 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bedb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bed8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bed88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a74bede480 con 0x55a74becc5d0 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a74bded060 con 0x55a74becdb40 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a74bede600 con 0x55a74bedb780 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4aa3457740 10 client.0 _ll_register_callbacks cb 0x55a74bb408c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:05.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bedb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bedb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35212/0 (socket says 172.21.15.100:35212) 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/4257873800 learned_addr learned my addr 172.21.15.100:0/4257873800 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bed8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bed88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 msgr2=0x55a74bed88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bed88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/4257873800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 msgr2=0x55a74bed8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bed8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.541+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/4257873800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74bba33c0 con 0x55a74becc5d0 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bed88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bedb0b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0cd520 tx=0x7f4a8c0bc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1673d1bbc25f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a7eff5640 1 -- 172.21.15.100:0/4257873800 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c09c370 con 0x55a74becc5d0 2024-09-12T02:09:05.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a7eff5640 1 -- 172.21.15.100:0/4257873800 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a8c011470 con 0x55a74becc5d0 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a90017ca0 con 0x55a74becc5d0 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a7eff5640 1 -- 172.21.15.100:0/4257873800 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a8c09c610 con 0x55a74becc5d0 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 10 client.15789 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a74bee9f00 con 0x55a74becc5d0 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a7eff5640 1 -- 172.21.15.100:0/4257873800 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a90017ca0 con 0x55a74becc5d0 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4a7eff5640 1 -- 172.21.15.100:0/4257873800 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4a8c00f040 con 0x55a74becc5d0 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 10 client.15789 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 10 client.15789 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 20 client.15789 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74beeb310 0x55a74beed720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 4 client.15789 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.542+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a74be3f860 con 0x55a74beeb310 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.543+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74beeb310 0x55a74beed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.543+0000 7f4a7eff5640 10 client.15789 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.543+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74beeb310 0x55a74beed720 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82207a2a3be91f29 server_cookie=7206db9cf85e8f97 in_seq=0 out_seq=0 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4a7eff5640 1 -- 172.21.15.100:0/4257873800 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a74be3f860 con 0x55a74beeb310 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4a7eff5640 10 client.15789 handle_command_reply: tid=0 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 client.15789 shutdown 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 msgr2=0x55a74bedb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bedb0b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0cd520 tx=0x7f4a8c0bc120 comp rx=0 tx=0).stop 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 shutdown_connections 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74beeb310 0x55a74beed720 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bed88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bed8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 --2- 172.21.15.100:0/4257873800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bedb0b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4a7eff5640 0 client.15789 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:09:05.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.544+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 >> 172.21.15.100:0/4257873800 conn(0x55a74be95310 msgr2=0x55a74bece960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:05.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.545+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 shutdown_connections 2024-09-12T02:09:05.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.545+0000 7f4aa3457740 1 -- 172.21.15.100:0/4257873800 wait complete. 2024-09-12T02:09:05.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.545+0000 7f4aa3457740 20 client.15789 trim_cache size 0 max 16384 2024-09-12T02:09:05.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.557+0000 7f4aa3457740 1 Processor -- start 2024-09-12T02:09:05.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.557+0000 7f4aa3457740 1 -- start start 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bec8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bee7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bef2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4aa3457740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c1adc00 con 0x55a74becc5d0 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4aa3457740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c1ab4a0 con 0x55a74becdb40 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4aa3457740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c1a9310 con 0x55a74bedb780 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bec8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bec8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35220/0 (socket says 172.21.15.100:35220) 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/2583706135 learned_addr learned my addr 172.21.15.100:0/2583706135 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bee7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bef2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/2583706135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 msgr2=0x55a74bef2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bef2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/2583706135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 msgr2=0x55a74bee7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bee7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 -- 172.21.15.100:0/2583706135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74bed68f0 con 0x55a74becc5d0 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bec8e10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c09bc10 tx=0x7f4a8c0092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c2032ddbb7db7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.558+0000 7f4a80ff9640 1 -- 172.21.15.100:0/2583706135 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0a02c0 con 0x55a74becc5d0 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4a80ff9640 1 -- 172.21.15.100:0/2583706135 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a8c0a4b80 con 0x55a74becc5d0 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4a80ff9640 1 -- 172.21.15.100:0/2583706135 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c09c3d0 con 0x55a74becc5d0 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 -- 172.21.15.100:0/2583706135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 msgr2=0x55a74bec8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bec8e10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c09bc10 tx=0x7f4a8c0092a0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 -- 172.21.15.100:0/2583706135 shutdown_connections 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74bedb780 0x55a74bef2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74becdb40 0x55a74bee7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 --2- 172.21.15.100:0/2583706135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becc5d0 0x55a74bec8e10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 -- 172.21.15.100:0/2583706135 >> 172.21.15.100:0/2583706135 conn(0x55a74be95310 msgr2=0x55a74bec8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 -- 172.21.15.100:0/2583706135 shutdown_connections 2024-09-12T02:09:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.559+0000 7f4aa3457740 1 -- 172.21.15.100:0/2583706135 wait complete. 2024-09-12T02:09:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 -- start start 2024-09-12T02:09:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 Processor -- start 2024-09-12T02:09:05.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74bee3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becdb40 0x55a74bed4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74bedb780 0x55a74bed5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c1a9960 con 0x55a74becdb40 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c1aadd0 con 0x55a74bedb780 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c1aa030 con 0x55a74becc5d0 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4aa3457740 10 client.0 _ll_register_callbacks cb 0x7f4a8c00ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becdb40 0x55a74bed4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becdb40 0x55a74bed4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35224/0 (socket says 172.21.15.100:35224) 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 -- 172.21.15.100:0/702534361 learned_addr learned my addr 172.21.15.100:0/702534361 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74bedb780 0x55a74bed5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74bee3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 -- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 msgr2=0x55a74bee3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74bee3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 -- 172.21.15.100:0/702534361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74bedb780 msgr2=0x55a74bed5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74bedb780 0x55a74bed5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9a59c640 1 -- 172.21.15.100:0/702534361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74bed5a00 con 0x55a74becdb40 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.560+0000 7f4a9b59e640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74bedb780 0x55a74bed5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4a9a59c640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becdb40 0x55a74bed4ed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000bbe0 tx=0x7f4a9000f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df83e02c97d949c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4a7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4a7eff5640 1 -- 172.21.15.100:0/702534361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9002f020 con 0x55a74becdb40 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4a7eff5640 1 -- 172.21.15.100:0/702534361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a9000b5d0 con 0x55a74becdb40 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a8c0a4b80 con 0x55a74becdb40 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4a7eff5640 1 -- 172.21.15.100:0/702534361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a9000f6f0 con 0x55a74becdb40 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 10 client.15795 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a74bf55d90 con 0x55a74becdb40 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4a7eff5640 1 -- 172.21.15.100:0/702534361 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a8c0a4b80 con 0x55a74becdb40 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4a7eff5640 1 -- 172.21.15.100:0/702534361 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4a9002a050 con 0x55a74becdb40 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 10 client.15795 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 10 client.15795 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 20 client.15795 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74bf561d0 0x55a74bf585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 4 client.15795 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.561+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 --> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a74be39d70 con 0x55a74bf561d0 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74bf561d0 0x55a74bf585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4a7eff5640 10 client.15795 ms_handle_connect on v2:172.21.15.189:6838/2548139728 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4a9ad9d640 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74bf561d0 0x55a74bf585c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=519921baf287cb5a server_cookie=288c98b32ac869a2 in_seq=0 out_seq=0 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4a7eff5640 1 -- 172.21.15.100:0/702534361 <== mds.1 v2:172.21.15.189:6838/2548139728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a74be39d70 con 0x55a74bf561d0 2024-09-12T02:09:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4a7eff5640 10 client.15795 handle_command_reply: tid=0 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 client.15795 shutdown 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becdb40 msgr2=0x55a74bed4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becdb40 0x55a74bed4ed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000bbe0 tx=0x7f4a9000f600 comp rx=0 tx=0).stop 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 shutdown_connections 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a74bedb780 0x55a74bed5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a74becdb40 0x55a74bed4ed0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:6838/2548139728,v1:172.21.15.189:6839/2548139728] conn(0x55a74bf561d0 0x55a74bf585c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 --2- 172.21.15.100:0/702534361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a74becc5d0 0x55a74bee3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4a7eff5640 0 client.15795 ms_handle_reset on v2:172.21.15.189:6838/2548139728 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 >> 172.21.15.100:0/702534361 conn(0x55a74be95310 msgr2=0x55a74bece110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.562+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 shutdown_connections 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa3457740 1 -- 172.21.15.100:0/702534361 wait complete. 2024-09-12T02:09:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa3457740 20 client.15795 trim_cache size 0 max 16384 2024-09-12T02:09:05.570 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:09:05.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a840a2c00 msgr2=0x7f4a840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a840a2c00 0x7f4a840a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009900 tx=0x7f4a9402a420 comp rx=0 tx=0).stop 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c100a80 msgr2=0x7f4a9c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c100a80 0x7f4a9c199230 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00eab0 tx=0x7f4a8c00ef70 comp rx=0 tx=0).stop 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 shutdown_connections 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4a840a2c00 0x7f4a840a50c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a9c106a80 0x7f4a9c1a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a9c101420 0x7f4a9c199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 --2- 172.21.15.100:0/1124104904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a9c100a80 0x7f4a9c199230 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 >> 172.21.15.100:0/1124104904 conn(0x7f4a9c0fc7a0 msgr2=0x7f4a9c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 shutdown_connections 2024-09-12T02:09:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:05.563+0000 7f4aa107e640 1 -- 172.21.15.100:0/1124104904 wait complete. 2024-09-12T02:09:05.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:05 smithi189 ceph-mon[35188]: pgmap v393: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-12T02:09:05.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:05 smithi117 ceph-mon[35240]: pgmap v393: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-12T02:09:06.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:09:06.522 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:06.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 -- 172.21.15.100:0/3333322555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c101de0 msgr2=0x7f4b3c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3333322555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c101de0 0x7f4b3c1021c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009900 tx=0x7f4b3802a410 comp rx=0 tx=0).stop 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 -- 172.21.15.100:0/3333322555 shutdown_connections 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3333322555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c106f10 0x7f4b3c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3333322555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c102790 0x7f4b3c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3333322555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c101de0 0x7f4b3c1021c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 -- 172.21.15.100:0/3333322555 >> 172.21.15.100:0/3333322555 conn(0x7f4b3c0fd8c0 msgr2=0x7f4b3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 -- 172.21.15.100:0/3333322555 shutdown_connections 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.985+0000 7f4b446a1640 1 -- 172.21.15.100:0/3333322555 wait complete. 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 Processor -- start 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 -- start start 2024-09-12T02:09:06.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c101de0 0x7f4b3c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c102790 0x7f4b3c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c106f10 0x7f4b3c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c111fb0 con 0x7f4b3c102790 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c111e30 con 0x7f4b3c106f10 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b446a1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c112130 con 0x7f4b3c101de0 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c102790 0x7f4b3c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c102790 0x7f4b3c1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35228/0 (socket says 172.21.15.100:35228) 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b41c3c640 1 -- 172.21.15.100:0/3424577459 learned_addr learned my addr 172.21.15.100:0/3424577459 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b4243d640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c101de0 0x7f4b3c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.986+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c106f10 0x7f4b3c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b41c3c640 1 -- 172.21.15.100:0/3424577459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c101de0 msgr2=0x7f4b3c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c101de0 0x7f4b3c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b41c3c640 1 -- 172.21.15.100:0/3424577459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c106f10 msgr2=0x7f4b3c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c106f10 0x7f4b3c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b41c3c640 1 -- 172.21.15.100:0/3424577459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c19d460 con 0x7f4b3c102790 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c106f10 0x7f4b3c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c102790 0x7f4b3c1989f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00d770 tx=0x7f4b2c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b337fe640 1 -- 172.21.15.100:0/3424577459 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c017070 con 0x7f4b3c102790 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b337fe640 1 -- 172.21.15.100:0/3424577459 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b2c005500 con 0x7f4b3c102790 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c19d750 con 0x7f4b3c102790 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b337fe640 1 -- 172.21.15.100:0/3424577459 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004e00 con 0x7f4b3c102790 2024-09-12T02:09:06.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.987+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a5030 con 0x7f4b3c102790 2024-09-12T02:09:06.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.989+0000 7f4b337fe640 1 -- 172.21.15.100:0/3424577459 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4b2c004fa0 con 0x7f4b3c102790 2024-09-12T02:09:06.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.989+0000 7f4b46a7a740 1 Processor -- start 2024-09-12T02:09:06.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b46a7a740 1 -- start start 2024-09-12T02:09:06.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b337fe640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b280a2c00 0x7f4b280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f47b40 0x5574d4f46090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f46a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f51370 0x5574d4f53760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5574d4eac2f0 con 0x5574d4f51370 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5574d4e53cf0 con 0x5574d4f47b40 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5574d4ea82b0 con 0x5574d4f465d0 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b337fe640 1 -- 172.21.15.100:0/3424577459 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4b2c0ceb10 con 0x7f4b3c102790 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b42c3e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f51370 0x5574d4f53760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f46a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b4243d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f47b40 0x5574d4f46090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b42c3e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f51370 0x5574d4f53760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35238/0 (socket says 172.21.15.100:35238) 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b42c3e640 1 -- 172.21.15.100:0/383549623 learned_addr learned my addr 172.21.15.100:0/383549623 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f46a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.100:50656/0 (socket says 172.21.15.100:50656) 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b4243d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f47b40 0x5574d4f46090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.100:58546/0 (socket says 172.21.15.100:58546) 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.990+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b280a2c00 0x7f4b280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b41c3c640 1 -- 172.21.15.100:0/383549623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f47b40 msgr2=0x5574d4f46090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f47b40 0x5574d4f46090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b41c3c640 1 -- 172.21.15.100:0/383549623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f51370 msgr2=0x5574d4f53760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f51370 0x5574d4f53760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b41c3c640 1 -- 172.21.15.100:0/383549623 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574d4e383a0 con 0x5574d4f465d0 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f51370 0x5574d4f53760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f46a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00d740 tx=0x7f4b2c0730d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff9151353c93b240 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b280a2c00 0x7f4b280a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5574d4f47070 tx=0x7f4b34008220 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b30ff9640 1 -- 172.21.15.100:0/383549623 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c020050 con 0x5574d4f465d0 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b30ff9640 1 -- 172.21.15.100:0/383549623 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b2c0046c0 con 0x5574d4f465d0 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.991+0000 7f4b30ff9640 1 -- 172.21.15.100:0/383549623 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c09f6d0 con 0x5574d4f465d0 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 -- 172.21.15.100:0/383549623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 msgr2=0x5574d4f46a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f46a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00d740 tx=0x7f4b2c0730d0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 -- 172.21.15.100:0/383549623 shutdown_connections 2024-09-12T02:09:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f51370 0x5574d4f53760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f46a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/383549623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f47b40 0x5574d4f46090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 -- 172.21.15.100:0/383549623 >> 172.21.15.100:0/383549623 conn(0x5574d4f0f310 msgr2=0x5574d4f42c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 -- 172.21.15.100:0/383549623 shutdown_connections 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 -- 172.21.15.100:0/383549623 wait complete. 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 -- start start 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.992+0000 7f4b46a7a740 1 Processor -- start 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f465d0 0x5574d4f50e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f47b40 0x5574d4f4e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5574d4f58420 con 0x5574d4f465d0 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5574d4e67060 con 0x5574d4f51370 2024-09-12T02:09:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5574d4f585a0 con 0x5574d4f47b40 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 10 client.0 _ll_register_callbacks cb 0x5574d4bba8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f465d0 0x5574d4f50e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f465d0 0x5574d4f50e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35242/0 (socket says 172.21.15.100:35242) 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 -- 172.21.15.100:0/1951300947 learned_addr learned my addr 172.21.15.100:0/1951300947 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 -- 172.21.15.100:0/1951300947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f47b40 msgr2=0x5574d4f4e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f47b40 0x5574d4f4e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 -- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 msgr2=0x5574d4f4e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 -- 172.21.15.100:0/1951300947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574d4c1d3c0 con 0x5574d4f465d0 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b4243d640 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f465d0 0x5574d4f50e00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009900 tx=0x7f4b38031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57cc77c502a2d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1951300947 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38035040 con 0x5574d4f465d0 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1951300947 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4b38004240 con 0x5574d4f465d0 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.993+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5574d4eb9860 con 0x5574d4f465d0 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1951300947 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4b38004440 con 0x5574d4f465d0 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 10 client.15807 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5574d4f63fc0 con 0x5574d4f465d0 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1951300947 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5574d4eb9860 con 0x5574d4f465d0 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1951300947 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4b38004c90 con 0x5574d4f465d0 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 10 client.15807 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 20 client.15807 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4f65480 0x5574d4f67910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 4 client.15807 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:09:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574d4eb3d70 con 0x5574d4f65480 2024-09-12T02:09:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.994+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4f65480 0x5574d4f67910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.995+0000 7f4b25ffb640 10 client.15807 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.995+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4f65480 0x5574d4f67910 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b8e463fe514c512 server_cookie=8cb9ff635b761928 in_seq=0 out_seq=0 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1951300947 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574d4eb3d70 con 0x5574d4f65480 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b25ffb640 10 client.15807 handle_command_reply: tid=0 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 client.15807 shutdown 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f465d0 msgr2=0x5574d4f50e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f465d0 0x5574d4f50e00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009900 tx=0x7f4b38031a60 comp rx=0 tx=0).stop 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 shutdown_connections 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4f65480 0x5574d4f67910 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f47b40 0x5574d4f4e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1951300947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f465d0 0x5574d4f50e00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 >> 172.21.15.100:0/1951300947 conn(0x5574d4f0f310 msgr2=0x5574d4f48960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b25ffb640 0 client.15807 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 shutdown_connections 2024-09-12T02:09:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1951300947 wait complete. 2024-09-12T02:09:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:06.996+0000 7f4b46a7a740 20 client.15807 trim_cache size 0 max 16384 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 Processor -- start 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 -- start start 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f465d0 0x5574d4f42e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f6d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f51370 0x5574d4f6d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1adbe0 con 0x5574d4f47b40 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1ab480 con 0x5574d4f465d0 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a92d0 con 0x5574d4f51370 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f6d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f6d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35254/0 (socket says 172.21.15.100:35254) 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 -- 172.21.15.100:0/384257729 learned_addr learned my addr 172.21.15.100:0/384257729 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f51370 0x5574d4f6d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b4243d640 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f465d0 0x5574d4f42e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 -- 172.21.15.100:0/384257729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f51370 msgr2=0x5574d4f6d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f51370 0x5574d4f6d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 -- 172.21.15.100:0/384257729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f465d0 msgr2=0x5574d4f42e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f465d0 0x5574d4f42e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b41c3c640 1 -- 172.21.15.100:0/384257729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574d4f4c600 con 0x5574d4f47b40 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f51370 0x5574d4f6d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.009+0000 7f4b4243d640 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f465d0 0x5574d4f42e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f6d1e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00d740 tx=0x7f4b2c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21766ccf46268b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b27fff640 1 -- 172.21.15.100:0/384257729 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c020040 con 0x5574d4f47b40 2024-09-12T02:09:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b27fff640 1 -- 172.21.15.100:0/384257729 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b2c09f6d0 con 0x5574d4f47b40 2024-09-12T02:09:07.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b27fff640 1 -- 172.21.15.100:0/384257729 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0996b0 con 0x5574d4f47b40 2024-09-12T02:09:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 -- 172.21.15.100:0/384257729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 msgr2=0x5574d4f6d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f6d1e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00d740 tx=0x7f4b2c009c30 comp rx=0 tx=0).stop 2024-09-12T02:09:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 -- 172.21.15.100:0/384257729 shutdown_connections 2024-09-12T02:09:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f51370 0x5574d4f6d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f6d1e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/384257729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f465d0 0x5574d4f42e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 -- 172.21.15.100:0/384257729 >> 172.21.15.100:0/384257729 conn(0x5574d4f0f310 msgr2=0x5574d4f42700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 -- 172.21.15.100:0/384257729 shutdown_connections 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.010+0000 7f4b46a7a740 1 -- 172.21.15.100:0/384257729 wait complete. 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 -- start start 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 Processor -- start 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f5d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f5dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a9940 con 0x5574d4f47b40 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1aadb0 con 0x5574d4f51370 2024-09-12T02:09:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1aa010 con 0x5574d4f465d0 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b46a7a740 10 client.0 _ll_register_callbacks cb 0x7f4b38009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f5dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f5dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35270/0 (socket says 172.21.15.100:35270) 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 -- 172.21.15.100:0/1226048971 learned_addr learned my addr 172.21.15.100:0/1226048971 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b4243d640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f5d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 -- 172.21.15.100:0/1226048971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 msgr2=0x5574d4f5d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f5d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 -- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 msgr2=0x5574d4f4a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.011+0000 7f4b41c3c640 1 -- 172.21.15.100:0/1226048971 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574d4f5e4b0 con 0x5574d4f47b40 2024-09-12T02:09:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b42c3e640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b41c3c640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f5dd70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c097730 tx=0x7f4b2c00de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c8aad4276c95b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1226048971 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0b4060 con 0x5574d4f47b40 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1226048971 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4b2c009cc0 con 0x5574d4f47b40 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2c09f6d0 con 0x5574d4f47b40 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1226048971 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4b2c0cc640 con 0x5574d4f47b40 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 10 client.15813 fetch_fsmap learned FSMap version 26 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5574d4fcf700 con 0x5574d4f47b40 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1226048971 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b2c09f6d0 con 0x5574d4f47b40 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1226048971 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4b2c0785d0 con 0x5574d4f47b40 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 10 client.15813 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 20 client.15813 populate_metadata read hostname 'smithi100' 2024-09-12T02:09:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4fcf920 0x5574d4fd1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 4 client.15813 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.012+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 --> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574d4e30170 con 0x5574d4fcf920 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b4243d640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4fcf920 0x5574d4fd1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b4243d640 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4fcf920 0x5574d4fd1d10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c43c4eb395b7f42a server_cookie=9e3921cbf8d196cf in_seq=0 out_seq=0 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b25ffb640 10 client.15813 ms_handle_connect on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b25ffb640 1 -- 172.21.15.100:0/1226048971 <== mds.0 v2:172.21.15.117:6838/3211661343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574d4e30170 con 0x5574d4fcf920 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b25ffb640 10 client.15813 handle_command_reply: tid=0 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 client.15813 shutdown 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 msgr2=0x5574d4f5dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f5dd70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c097730 tx=0x7f4b2c00de80 comp rx=0 tx=0).stop 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 shutdown_connections 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:6838/3211661343,v1:172.21.15.117:6839/3211661343] conn(0x5574d4fcf920 0x5574d4fd1d10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5574d4f51370 0x5574d4f4a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574d4f47b40 0x5574d4f5dd70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 --2- 172.21.15.100:0/1226048971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574d4f465d0 0x5574d4f5d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b25ffb640 0 client.15813 ms_handle_reset on v2:172.21.15.117:6838/3211661343 2024-09-12T02:09:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.013+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 >> 172.21.15.100:0/1226048971 conn(0x5574d4f0f310 msgr2=0x5574d4f4d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 shutdown_connections 2024-09-12T02:09:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b46a7a740 1 -- 172.21.15.100:0/1226048971 wait complete. 2024-09-12T02:09:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b46a7a740 20 client.15813 trim_cache size 0 max 16384 2024-09-12T02:09:07.020 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b280a2c00 msgr2=0x7f4b280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b280a2c00 0x7f4b280a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5574d4f47070 tx=0x7f4b34008220 comp rx=0 tx=0).stop 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c102790 msgr2=0x7f4b3c1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c102790 0x7f4b3c1989f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00d770 tx=0x7f4b2c00dc30 comp rx=0 tx=0).stop 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 shutdown_connections 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f4b280a2c00 0x7f4b280a50c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b3c106f10 0x7f4b3c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b3c102790 0x7f4b3c1989f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 --2- 172.21.15.100:0/3424577459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b3c101de0 0x7f4b3c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 >> 172.21.15.100:0/3424577459 conn(0x7f4b3c0fd8c0 msgr2=0x7f4b3c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:07.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 shutdown_connections 2024-09-12T02:09:07.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.014+0000 7f4b446a1640 1 -- 172.21.15.100:0/3424577459 wait complete. 2024-09-12T02:09:07.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:07 smithi100 ceph-mon[31179]: pgmap v394: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-12T02:09:07.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:07 smithi189 ceph-mon[35188]: pgmap v394: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-12T02:09:07.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:07 smithi117 ceph-mon[35240]: pgmap v394: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-12T02:09:07.695 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T02:09:07.696 INFO:tasks.fwd_scrub:done joining 2024-09-12T02:09:07.696 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T02:09:07.706 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:09:07.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 -- 172.21.15.100:0/1722927974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 msgr2=0x7f813c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 --2- 172.21.15.100:0/1722927974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c1031a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f812c009900 tx=0x7f812c02a410 comp rx=0 tx=0).stop 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 -- 172.21.15.100:0/1722927974 shutdown_connections 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 --2- 172.21.15.100:0/1722927974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f813c1036e0 0x7f813c109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 --2- 172.21.15.100:0/1722927974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c1031a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 --2- 172.21.15.100:0/1722927974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c101b30 0x7f813c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 -- 172.21.15.100:0/1722927974 >> 172.21.15.100:0/1722927974 conn(0x7f813c0fd290 msgr2=0x7f813c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 -- 172.21.15.100:0/1722927974 shutdown_connections 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.808+0000 7f814183c640 1 -- 172.21.15.100:0/1722927974 wait complete. 2024-09-12T02:09:07.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 Processor -- start 2024-09-12T02:09:07.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 -- start start 2024-09-12T02:09:07.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f813c101b30 0x7f813c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c1036e0 0x7f813c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10d810 con 0x7f813c102d20 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10d690 con 0x7f813c1036e0 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f814183c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10d990 con 0x7f813c101b30 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35302/0 (socket says 172.21.15.100:35302) 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 -- 172.21.15.100:0/814913996 learned_addr learned my addr 172.21.15.100:0/814913996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813b7fe640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c1036e0 0x7f813c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 -- 172.21.15.100:0/814913996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f813c101b30 msgr2=0x7f813c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813affd640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f813c101b30 0x7f813c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f813c101b30 0x7f813c075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 -- 172.21.15.100:0/814913996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c1036e0 msgr2=0x7f813c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c1036e0 0x7f813c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813a7fc640 1 -- 172.21.15.100:0/814913996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0753b0 con 0x7f813c102d20 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.809+0000 7f813b7fe640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c1036e0 0x7f813c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.810+0000 7f813a7fc640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c0745e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f812c009230 tx=0x7f812c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.810+0000 7f814083a640 1 -- 172.21.15.100:0/814913996 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c03f030 con 0x7f813c102d20 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.810+0000 7f814083a640 1 -- 172.21.15.100:0/814913996 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f812c003ce0 con 0x7f813c102d20 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.810+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c1a1f80 con 0x7f813c102d20 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.810+0000 7f814083a640 1 -- 172.21.15.100:0/814913996 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c035070 con 0x7f813c102d20 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.810+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c1a2460 con 0x7f813c102d20 2024-09-12T02:09:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.811+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c108f60 con 0x7f813c102d20 2024-09-12T02:09:07.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.812+0000 7f814083a640 1 -- 172.21.15.100:0/814913996 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f812c042030 con 0x7f813c102d20 2024-09-12T02:09:07.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.812+0000 7f814083a640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f81240a2b90 0x7f81240a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:07.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.813+0000 7f813affd640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f81240a2b90 0x7f81240a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:07.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.813+0000 7f814083a640 1 -- 172.21.15.100:0/814913996 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f812c0efa50 con 0x7f813c102d20 2024-09-12T02:09:07.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.813+0000 7f813affd640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f81240a2b90 0x7f81240a5050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8130005fd0 tx=0x7f8130005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:07.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.816+0000 7f814083a640 1 -- 172.21.15.100:0/814913996 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f812c0bc9c0 con 0x7f813c102d20 2024-09-12T02:09:07.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.980+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f813c02da30 con 0x7f813c102d20 2024-09-12T02:09:07.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.982+0000 7f814083a640 1 -- 172.21.15.100:0/814913996 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7f812c0bc2c0 con 0x7f813c102d20 2024-09-12T02:09:07.982 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:09:07.982 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f81240a2b90 msgr2=0x7f81240a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f81240a2b90 0x7f81240a5050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8130005fd0 tx=0x7f8130005850 comp rx=0 tx=0).stop 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 msgr2=0x7f813c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c0745e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f812c009230 tx=0x7f812c004360 comp rx=0 tx=0).stop 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 shutdown_connections 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f81240a2b90 0x7f81240a5050 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c1036e0 0x7f813c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f813c102d20 0x7f813c0745e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 --2- 172.21.15.100:0/814913996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f813c101b30 0x7f813c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 >> 172.21.15.100:0/814913996 conn(0x7f813c0fd290 msgr2=0x7f813c106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 shutdown_connections 2024-09-12T02:09:07.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:07.984+0000 7f814183c640 1 -- 172.21.15.100:0/814913996 wait complete. 2024-09-12T02:09:07.995 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:00:34.232777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:05:03.311397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:05:05.761455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:09:07.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:09:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- 172.21.15.100:0/1018132036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17701077f0 msgr2=0x7f1770109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 --2- 172.21.15.100:0/1018132036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17701077f0 0x7f1770109c60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1768009ca0 tx=0x7f176802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- 172.21.15.100:0/1018132036 shutdown_connections 2024-09-12T02:09:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 --2- 172.21.15.100:0/1018132036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17701077f0 0x7f1770109c60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 --2- 172.21.15.100:0/1018132036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1770104ec0 0x7f17701072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 --2- 172.21.15.100:0/1018132036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1770102590 0x7f1770104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- 172.21.15.100:0/1018132036 >> 172.21.15.100:0/1018132036 conn(0x7f17700fc190 msgr2=0x7f17700fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- 172.21.15.100:0/1018132036 shutdown_connections 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- 172.21.15.100:0/1018132036 wait complete. 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 Processor -- start 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- start start 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1770102590 0x7f1770197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1770104ec0 0x7f17701983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17701077f0 0x7f177019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f177010d7d0 con 0x7f1770102590 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f177010d650 con 0x7f17701077f0 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.099+0000 7f1778035640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f177010d950 con 0x7f1770104ec0 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1770102590 0x7f1770197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1770102590 0x7f1770197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35332/0 (socket says 172.21.15.100:35332) 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 -- 172.21.15.100:0/3313163440 learned_addr learned my addr 172.21.15.100:0/3313163440 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f17765d2640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17701077f0 0x7f177019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f17755d0640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1770104ec0 0x7f17701983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 -- 172.21.15.100:0/3313163440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1770104ec0 msgr2=0x7f17701983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1770104ec0 0x7f17701983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 -- 172.21.15.100:0/3313163440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17701077f0 msgr2=0x7f177019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17701077f0 0x7f177019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 -- 172.21.15.100:0/3313163440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177019fad0 con 0x7f1770102590 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1775dd1640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1770102590 0x7f1770197eb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d950 tx=0x7f176c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1766ffd640 1 -- 172.21.15.100:0/3313163440 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c017030 con 0x7f1770102590 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1766ffd640 1 -- 172.21.15.100:0/3313163440 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f176c004020 con 0x7f1770102590 2024-09-12T02:09:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177019fdc0 con 0x7f1770102590 2024-09-12T02:09:08.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1766ffd640 1 -- 172.21.15.100:0/3313163440 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0047a0 con 0x7f1770102590 2024-09-12T02:09:08.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.100+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17701a0230 con 0x7f1770102590 2024-09-12T02:09:08.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.101+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17700fdc80 con 0x7f1770102590 2024-09-12T02:09:08.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.102+0000 7f1766ffd640 1 -- 172.21.15.100:0/3313163440 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f176c0041d0 con 0x7f1770102590 2024-09-12T02:09:08.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.103+0000 7f1766ffd640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f175c0a2b90 0x7f175c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.103+0000 7f17755d0640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f175c0a2b90 0x7f175c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.103+0000 7f1766ffd640 1 -- 172.21.15.100:0/3313163440 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f176c0cf100 con 0x7f1770102590 2024-09-12T02:09:08.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.103+0000 7f17755d0640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f175c0a2b90 0x7f175c0a5050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1760005d70 tx=0x7f1760005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.106+0000 7f1766ffd640 1 -- 172.21.15.100:0/3313163440 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f176c09c070 con 0x7f1770102590 2024-09-12T02:09:08.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.271+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f177002da30 con 0x7f1770102590 2024-09-12T02:09:08.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.272+0000 7f1766ffd640 1 -- 172.21.15.100:0/3313163440 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f176c09b970 con 0x7f1770102590 2024-09-12T02:09:08.272 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-12T02:09:08.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f175c0a2b90 msgr2=0x7f175c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f175c0a2b90 0x7f175c0a5050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1760005d70 tx=0x7f1760005d00 comp rx=0 tx=0).stop 2024-09-12T02:09:08.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1770102590 msgr2=0x7f1770197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1770102590 0x7f1770197eb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d950 tx=0x7f176c00de10 comp rx=0 tx=0).stop 2024-09-12T02:09:08.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 shutdown_connections 2024-09-12T02:09:08.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f175c0a2b90 0x7f175c0a5050 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17701077f0 0x7f177019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1770104ec0 0x7f17701983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 --2- 172.21.15.100:0/3313163440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1770102590 0x7f1770197eb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 >> 172.21.15.100:0/3313163440 conn(0x7f17700fc190 msgr2=0x7f1770102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:08.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 shutdown_connections 2024-09-12T02:09:08.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.274+0000 7f1778035640 1 -- 172.21.15.100:0/3313163440 wait complete. 2024-09-12T02:09:08.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:08 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/814913996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:08.285 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 -- 172.21.15.100:0/3721213054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25881025b0 msgr2=0x7f25881049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 --2- 172.21.15.100:0/3721213054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25881025b0 0x7f25881049a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2578009900 tx=0x7f257802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 -- 172.21.15.100:0/3721213054 shutdown_connections 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 --2- 172.21.15.100:0/3721213054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2588107810 0x7f2588109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 --2- 172.21.15.100:0/3721213054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2588104ee0 0x7f25881072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 --2- 172.21.15.100:0/3721213054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25881025b0 0x7f25881049a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 -- 172.21.15.100:0/3721213054 >> 172.21.15.100:0/3721213054 conn(0x7f25880fc1b0 msgr2=0x7f25880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 -- 172.21.15.100:0/3721213054 shutdown_connections 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.386+0000 7f258e02e640 1 -- 172.21.15.100:0/3721213054 wait complete. 2024-09-12T02:09:08.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 Processor -- start 2024-09-12T02:09:08.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 -- start start 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25881025b0 0x7f2588197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2588104ee0 0x7f25881983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588107810 0x7f258819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f258810d7f0 con 0x7f2588107810 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f258810d670 con 0x7f2588104ee0 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f258e02e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f258810d970 con 0x7f25881025b0 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f2587fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588107810 0x7f258819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f2587fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588107810 0x7f258819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35360/0 (socket says 172.21.15.100:35360) 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f2587fff640 1 -- 172.21.15.100:0/767118982 learned_addr learned my addr 172.21.15.100:0/767118982 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.387+0000 7f25877fe640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25881025b0 0x7f2588197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2586ffd640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2588104ee0 0x7f25881983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2587fff640 1 -- 172.21.15.100:0/767118982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25881025b0 msgr2=0x7f2588197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2587fff640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25881025b0 0x7f2588197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2587fff640 1 -- 172.21.15.100:0/767118982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2588104ee0 msgr2=0x7f25881983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2587fff640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2588104ee0 0x7f25881983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2587fff640 1 -- 172.21.15.100:0/767118982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258819fad0 con 0x7f2588107810 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2586ffd640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2588104ee0 0x7f25881983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2587fff640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588107810 0x7f258819f460 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f258000ccb0 tx=0x7f258000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2584ff9640 1 -- 172.21.15.100:0/767118982 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258000f450 con 0x7f2588107810 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2584ff9640 1 -- 172.21.15.100:0/767118982 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f258000fad0 con 0x7f2588107810 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258819fdc0 con 0x7f2588107810 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f2584ff9640 1 -- 172.21.15.100:0/767118982 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580018bf0 con 0x7f2588107810 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.388+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25881a0230 con 0x7f2588107810 2024-09-12T02:09:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.389+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25880fdca0 con 0x7f2588107810 2024-09-12T02:09:08.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.390+0000 7f2584ff9640 1 -- 172.21.15.100:0/767118982 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f258000f5f0 con 0x7f2588107810 2024-09-12T02:09:08.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.391+0000 7f2584ff9640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25700a2b90 0x7f25700a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.391+0000 7f2584ff9640 1 -- 172.21.15.100:0/767118982 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f25800cf790 con 0x7f2588107810 2024-09-12T02:09:08.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.391+0000 7f25877fe640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25700a2b90 0x7f25700a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.391+0000 7f25877fe640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25700a2b90 0x7f25700a5050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2578009230 tx=0x7f25780315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.394+0000 7f2584ff9640 1 -- 172.21.15.100:0/767118982 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2580014030 con 0x7f2588107810 2024-09-12T02:09:08.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.561+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2588062e90 con 0x7f2588107810 2024-09-12T02:09:08.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.562+0000 7f2584ff9640 1 -- 172.21.15.100:0/767118982 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f258009c790 con 0x7f2588107810 2024-09-12T02:09:08.562 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-12T02:09:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25700a2b90 msgr2=0x7f25700a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25700a2b90 0x7f25700a5050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2578009230 tx=0x7f25780315b0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588107810 msgr2=0x7f258819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588107810 0x7f258819f460 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f258000ccb0 tx=0x7f258000a620 comp rx=0 tx=0).stop 2024-09-12T02:09:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 shutdown_connections 2024-09-12T02:09:08.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f25700a2b90 0x7f25700a5050 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588107810 0x7f258819f460 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2588104ee0 0x7f25881983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 --2- 172.21.15.100:0/767118982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25881025b0 0x7f2588197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 >> 172.21.15.100:0/767118982 conn(0x7f25880fc1b0 msgr2=0x7f2588102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:08.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 shutdown_connections 2024-09-12T02:09:08.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.564+0000 7f258e02e640 1 -- 172.21.15.100:0/767118982 wait complete. 2024-09-12T02:09:08.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:09:08.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:08 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/814913996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:08.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:08 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/814913996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:08.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 -- 172.21.15.100:0/4155989245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c100a00 msgr2=0x7efe0c100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 --2- 172.21.15.100:0/4155989245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c100a00 0x7efe0c100e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efe08009900 tx=0x7efe0802a410 comp rx=0 tx=0).stop 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 -- 172.21.15.100:0/4155989245 shutdown_connections 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 --2- 172.21.15.100:0/4155989245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c1025b0 0x7efe0c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 --2- 172.21.15.100:0/4155989245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c101bf0 0x7efe0c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 --2- 172.21.15.100:0/4155989245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c100a00 0x7efe0c100e00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 -- 172.21.15.100:0/4155989245 >> 172.21.15.100:0/4155989245 conn(0x7efe0c0fc160 msgr2=0x7efe0c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 -- 172.21.15.100:0/4155989245 shutdown_connections 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.677+0000 7efe133cf640 1 -- 172.21.15.100:0/4155989245 wait complete. 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 Processor -- start 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 -- start start 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c100a00 0x7efe0c06aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c101bf0 0x7efe0c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c1025b0 0x7efe0c19f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10c680 con 0x7efe0c1025b0 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10c500 con 0x7efe0c101bf0 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe133cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10c800 con 0x7efe0c100a00 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c1025b0 0x7efe0c19f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c1025b0 0x7efe0c19f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35384/0 (socket says 172.21.15.100:35384) 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 -- 172.21.15.100:0/2519509534 learned_addr learned my addr 172.21.15.100:0/2519509534 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1116b640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c100a00 0x7efe0c06aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1096a640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c101bf0 0x7efe0c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 -- 172.21.15.100:0/2519509534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c100a00 msgr2=0x7efe0c06aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c100a00 0x7efe0c06aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 -- 172.21.15.100:0/2519509534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c101bf0 msgr2=0x7efe0c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c101bf0 0x7efe0c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.678+0000 7efe1196c640 1 -- 172.21.15.100:0/2519509534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c19fb40 con 0x7efe0c1025b0 2024-09-12T02:09:08.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.679+0000 7efe1196c640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c1025b0 0x7efe0c19f230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efe0400eaa0 tx=0x7efe0400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.679+0000 7efe027fc640 1 -- 172.21.15.100:0/2519509534 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400cdb0 con 0x7efe0c1025b0 2024-09-12T02:09:08.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.679+0000 7efe027fc640 1 -- 172.21.15.100:0/2519509534 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe04005020 con 0x7efe0c1025b0 2024-09-12T02:09:08.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.679+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c19fdd0 con 0x7efe0c1025b0 2024-09-12T02:09:08.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.679+0000 7efe027fc640 1 -- 172.21.15.100:0/2519509534 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040116b0 con 0x7efe0c1025b0 2024-09-12T02:09:08.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.679+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c1a0290 con 0x7efe0c1025b0 2024-09-12T02:09:08.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.680+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0c107ee0 con 0x7efe0c1025b0 2024-09-12T02:09:08.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.681+0000 7efe027fc640 1 -- 172.21.15.100:0/2519509534 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7efe04005560 con 0x7efe0c1025b0 2024-09-12T02:09:08.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.682+0000 7efe027fc640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efdf80a2c10 0x7efdf80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.682+0000 7efe1116b640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efdf80a2c10 0x7efdf80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.682+0000 7efe027fc640 1 -- 172.21.15.100:0/2519509534 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efe040cf2d0 con 0x7efe0c1025b0 2024-09-12T02:09:08.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.682+0000 7efe1116b640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efdf80a2c10 0x7efdf80a50d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe08006010 tx=0x7efe08000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.686+0000 7efe027fc640 1 -- 172.21.15.100:0/2519509534 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe04016030 con 0x7efe0c1025b0 2024-09-12T02:09:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.851+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efe0c062e90 con 0x7efe0c1025b0 2024-09-12T02:09:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.852+0000 7efe027fc640 1 -- 172.21.15.100:0/2519509534 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7efe0409c240 con 0x7efe0c1025b0 2024-09-12T02:09:08.852 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-09-12T02:09:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efdf80a2c10 msgr2=0x7efdf80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efdf80a2c10 0x7efdf80a50d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe08006010 tx=0x7efe08000bc0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c1025b0 msgr2=0x7efe0c19f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c1025b0 0x7efe0c19f230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efe0400eaa0 tx=0x7efe0400ef60 comp rx=0 tx=0).stop 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 shutdown_connections 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7efdf80a2c10 0x7efdf80a50d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe0c1025b0 0x7efe0c19f230 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe0c101bf0 0x7efe0c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.853+0000 7efe133cf640 1 --2- 172.21.15.100:0/2519509534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe0c100a00 0x7efe0c06aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.854+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 >> 172.21.15.100:0/2519509534 conn(0x7efe0c0fc160 msgr2=0x7efe0c1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.854+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 shutdown_connections 2024-09-12T02:09:08.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.854+0000 7efe133cf640 1 -- 172.21.15.100:0/2519509534 wait complete. 2024-09-12T02:09:08.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 -- 172.21.15.100:0/3944353414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c1036e0 msgr2=0x7f9c0c109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 --2- 172.21.15.100:0/3944353414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c1036e0 0x7f9c0c109f70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009ca0 tx=0x7f9c0402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 -- 172.21.15.100:0/3944353414 shutdown_connections 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 --2- 172.21.15.100:0/3944353414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c1036e0 0x7f9c0c109f70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 --2- 172.21.15.100:0/3944353414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c0c102d20 0x7f9c0c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 --2- 172.21.15.100:0/3944353414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c101b30 0x7f9c0c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 -- 172.21.15.100:0/3944353414 >> 172.21.15.100:0/3944353414 conn(0x7f9c0c0fd270 msgr2=0x7f9c0c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 -- 172.21.15.100:0/3944353414 shutdown_connections 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.963+0000 7f9c119cf640 1 -- 172.21.15.100:0/3944353414 wait complete. 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 Processor -- start 2024-09-12T02:09:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 -- start start 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c0c101b30 0x7f9c0c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c102d20 0x7f9c0c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c1036e0 0x7f9c0c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c10d7b0 con 0x7f9c0c102d20 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c10d630 con 0x7f9c0c1036e0 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c119cf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c10d930 con 0x7f9c0c101b30 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c102d20 0x7f9c0c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c102d20 0x7f9c0c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35412/0 (socket says 172.21.15.100:35412) 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 -- 172.21.15.100:0/4085522041 learned_addr learned my addr 172.21.15.100:0/4085522041 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c0affd640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c0c101b30 0x7f9c0c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c0b7fe640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c1036e0 0x7f9c0c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 -- 172.21.15.100:0/4085522041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c0c101b30 msgr2=0x7f9c0c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c0c101b30 0x7f9c0c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 -- 172.21.15.100:0/4085522041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c1036e0 msgr2=0x7f9c0c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c1036e0 0x7f9c0c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.964+0000 7f9c027fc640 1 -- 172.21.15.100:0/4085522041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c0753b0 con 0x7f9c0c102d20 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.965+0000 7f9c0b7fe640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c1036e0 0x7f9c0c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.965+0000 7f9c027fc640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c102d20 0x7f9c0c0745e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400d770 tx=0x7f9bf400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.965+0000 7f9c109cd640 1 -- 172.21.15.100:0/4085522041 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4017070 con 0x7f9c0c102d20 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.965+0000 7f9c109cd640 1 -- 172.21.15.100:0/4085522041 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf4005500 con 0x7f9c0c102d20 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.965+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c1a1f20 con 0x7f9c0c102d20 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.965+0000 7f9c109cd640 1 -- 172.21.15.100:0/4085522041 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4004e00 con 0x7f9c0c102d20 2024-09-12T02:09:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.965+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c1a2330 con 0x7f9c0c102d20 2024-09-12T02:09:08.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.966+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0c108f70 con 0x7f9c0c102d20 2024-09-12T02:09:08.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.967+0000 7f9c109cd640 1 -- 172.21.15.100:0/4085522041 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9bf4004fa0 con 0x7f9c0c102d20 2024-09-12T02:09:08.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.968+0000 7f9c109cd640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9bf80a2b90 0x7f9bf80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:08.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.968+0000 7f9c0affd640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9bf80a2b90 0x7f9bf80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:08.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.968+0000 7f9c109cd640 1 -- 172.21.15.100:0/4085522041 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9bf40ceea0 con 0x7f9c0c102d20 2024-09-12T02:09:08.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.968+0000 7f9c0affd640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9bf80a2b90 0x7f9bf80a5050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc005fd0 tx=0x7f9bfc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:08.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:08.971+0000 7f9c109cd640 1 -- 172.21.15.100:0/4085522041 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bf409be10 con 0x7f9c0c102d20 2024-09-12T02:09:09.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.182+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9c0c02da10 con 0x7f9c0c102d20 2024-09-12T02:09:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.189+0000 7f9c109cd640 1 -- 172.21.15.100:0/4085522041 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740379 (secure 0 0 0) 0x7f9bf409b710 con 0x7f9c0c102d20 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 18, 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout: "active_gid": 14150, 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout: "active_name": "x", 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addrs": { 2024-09-12T02:09:09.199 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6800", 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3532459665 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6801", 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3532459665 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:09.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addr": "172.21.15.100:6801/3532459665", 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "active_change": "2024-09-12T01:58:21.937389+0000", 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "available": true, 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "standbys": [ 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 24109, 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "z", 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-09-12T02:09:09.201 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:09:09.202 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.203 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.205 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.206 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.207 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.209 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.210 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.211 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-09-12T02:09:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.217 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.218 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:09:09.219 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:09.220 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.221 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-09-12T02:09:09.222 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.224 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.225 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.226 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.227 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.228 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.229 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.230 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-09-12T02:09:09.232 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.233 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.234 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.235 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:09:09.236 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.238 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.239 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.240 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.241 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.242 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.243 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.244 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.245 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.246 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.247 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.248 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.249 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.250 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.251 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.252 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.253 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:09:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:09:09.255 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.256 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.257 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.260 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.261 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.262 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:09:09.263 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:09:09.264 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.265 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.266 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.269 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.270 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.272 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-09-12T02:09:09.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-09-12T02:09:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-09-12T02:09:09.275 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.276 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.277 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.278 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.279 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-09-12T02:09:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-09-12T02:09:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.292 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.293 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.294 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.296 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.298 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.299 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.300 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.301 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.302 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.303 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.304 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.305 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.306 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.307 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.308 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.309 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.310 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.311 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.313 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.314 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.315 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.316 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.317 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.319 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.320 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.321 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.322 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.323 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:09:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:09:09.325 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:09:09.326 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:09:09.327 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:09:09.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.329 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.330 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.331 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.333 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.334 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.335 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.336 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.337 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.338 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.339 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.340 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.341 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.342 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:09:09.344 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:09:09.345 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.346 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.347 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.350 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.351 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.352 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.353 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.355 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.357 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.358 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.359 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.360 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.361 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.362 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.363 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.364 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.366 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.367 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.368 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.370 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.371 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.372 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.373 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.374 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.375 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.376 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.377 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.379 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-09-12T02:09:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.381 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.383 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.384 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.385 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.386 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-09-12T02:09:09.387 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-09-12T02:09:09.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-09-12T02:09:09.389 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-09-12T02:09:09.390 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.391 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.394 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.395 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.396 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.397 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.398 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.399 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.400 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.401 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-09-12T02:09:09.402 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.404 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.405 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-09-12T02:09:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.407 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.409 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.410 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.411 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-09-12T02:09:09.412 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-09-12T02:09:09.413 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:09:09.414 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.415 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.418 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.419 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.420 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.421 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.422 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.423 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.424 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.425 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.426 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.427 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.428 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.430 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.431 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.433 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.434 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.435 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.436 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.437 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.438 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:09:09.440 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.441 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.442 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.445 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.447 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-09-12T02:09:09.448 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.449 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.450 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.452 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.453 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.455 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.457 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.458 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.459 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.463 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.464 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.465 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.466 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.467 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.468 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.469 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.471 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.472 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:09:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-09-12T02:09:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-09-12T02:09:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-09-12T02:09:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.591 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.592 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.593 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.594 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.595 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.596 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.599 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-09-12T02:09:09.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.601 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.603 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.604 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.605 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.607 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.608 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.609 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-09-12T02:09:09.610 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.611 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.612 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.613 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.614 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.615 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.616 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-09-12T02:09:09.617 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.618 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.620 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.621 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.622 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.623 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.624 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.625 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.626 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.627 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.629 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.630 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.631 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.632 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.633 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.634 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.635 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.636 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.637 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.638 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.639 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:09:09.640 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.641 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.642 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.644 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.645 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.646 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.648 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.649 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:09:09.650 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.651 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-09-12T02:09:09.652 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.653 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.654 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.655 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.656 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.658 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.659 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.660 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-09-12T02:09:09.661 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-09-12T02:09:09.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-09-12T02:09:09.663 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 24116, 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "y", 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-09-12T02:09:09.665 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:09:09.666 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.667 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.668 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.669 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.670 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.672 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.673 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.674 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-09-12T02:09:09.675 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.677 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-09-12T02:09:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-09-12T02:09:09.680 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.680 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.680 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.680 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.680 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.680 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-09-12T02:09:09.682 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.684 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-09-12T02:09:09.685 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.686 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.687 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.688 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.689 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.690 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.691 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.692 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.695 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.697 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.698 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-09-12T02:09:09.699 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.700 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.701 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.702 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:09.703 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:09:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:09:09.707 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.708 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.709 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.710 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.711 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-09-12T02:09:09.712 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.713 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.714 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.716 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:09:09.717 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:09:09.718 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.719 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.720 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.721 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.722 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.723 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-09-12T02:09:09.724 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-09-12T02:09:09.725 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.726 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.727 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.728 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.729 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:09:09.730 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.731 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.733 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.734 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:09:09.735 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.736 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.737 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:09:09.738 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.739 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.740 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.742 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.743 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.744 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.745 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.746 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.748 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.750 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.751 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.752 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:09:09.753 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.754 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.755 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.757 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.758 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.759 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.760 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-09-12T02:09:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:09:09.765 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.766 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.767 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-09-12T02:09:09.768 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-09-12T02:09:09.769 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-09-12T02:09:09.770 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-09-12T02:09:09.771 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.772 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.773 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.774 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.775 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.776 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.777 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.778 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.779 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.780 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.782 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.786 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.787 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.788 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.789 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.790 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.791 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.792 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.794 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.795 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:09:09.797 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:09:09.798 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-09-12T02:09:09.799 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:09:09.800 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:09:09.801 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:09:09.802 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.804 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.805 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.806 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.808 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.809 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.810 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.811 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.812 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.813 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.814 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:09:09.815 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.816 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.817 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.818 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:09:09.819 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.821 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.822 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.823 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.825 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.826 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.827 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.828 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.830 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.832 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.833 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.835 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.836 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.837 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.838 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.840 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.843 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.844 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.845 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.846 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:09:09.847 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.848 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.849 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.850 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.852 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.853 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.854 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.855 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.857 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.859 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.860 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.861 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.862 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:09:09.863 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.864 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-09-12T02:09:09.865 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:09:09.866 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.867 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.868 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.869 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.870 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.871 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-09-12T02:09:09.872 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-09-12T02:09:09.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.874 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.876 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.877 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.878 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.879 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.880 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.881 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.883 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.884 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.885 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.886 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.887 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.889 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.890 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.892 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.893 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.894 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.895 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.896 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-09-12T02:09:09.897 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.898 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.899 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.900 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.901 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.901 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.904 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.905 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-09-12T02:09:09.906 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:09:09.907 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.908 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.909 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.910 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.911 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.912 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.913 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.914 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:09:09.915 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.916 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.917 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.918 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.919 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.920 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.921 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.922 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.923 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.924 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-09-12T02:09:09.924 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.924 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.924 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.924 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:09:09.924 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.924 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.925 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.926 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.928 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.929 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.930 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.931 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.932 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.935 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.936 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.937 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.938 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.939 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.940 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.941 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.942 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.943 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.944 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.945 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.961 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.962 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:09:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-09-12T02:09:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:09:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-09-12T02:09:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-09-12T02:09:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.041 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.042 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.043 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-09-12T02:09:10.044 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-09-12T02:09:10.045 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-09-12T02:09:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-09-12T02:09:10.047 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.048 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.050 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.051 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.054 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.055 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.056 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.057 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-09-12T02:09:10.058 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-09-12T02:09:10.059 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.060 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.061 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.062 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.063 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.064 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.065 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.066 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.067 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.068 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.069 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.070 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.072 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.075 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.076 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-09-12T02:09:10.077 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.078 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.079 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.080 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.081 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.082 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.083 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.084 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.085 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.086 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.088 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.089 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.092 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.093 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.094 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.095 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.096 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.097 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.098 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.099 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.102 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.103 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.104 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-09-12T02:09:10.105 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-09-12T02:09:10.106 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.107 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.108 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.109 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.110 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.113 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.114 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.115 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.116 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.117 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.118 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-09-12T02:09:10.119 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-09-12T02:09:10.120 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-09-12T02:09:10.121 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.122 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.124 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.126 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.129 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.130 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.131 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-09-12T02:09:10.132 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.133 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.135 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: "modules": [ 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: "dashboard", 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: "iostat", 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: "nfs", 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: "restful" 2024-09-12T02:09:10.136 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.137 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.138 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.139 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.140 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.141 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.142 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.143 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.144 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.145 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.146 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.147 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.148 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.149 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.150 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.151 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.152 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.153 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:09:10.154 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.155 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-09-12T02:09:10.156 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.157 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-09-12T02:09:10.158 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.159 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-09-12T02:09:10.160 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.161 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.162 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.163 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.164 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.167 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.170 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.171 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.173 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.174 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.175 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.176 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.177 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.178 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.179 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.180 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.182 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.183 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:09:10.184 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.185 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.186 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.187 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.188 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:09:10.189 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:09:10.190 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:09:10.191 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.192 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.193 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.194 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.195 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.196 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.197 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.198 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_samba": { 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_samba", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.199 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:09:10.200 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-09-12T02:09:10.201 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.202 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.205 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.206 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "grafana_dashboards_path": { 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:09:10.210 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:09:10.211 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.212 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.213 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.214 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.215 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.216 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.218 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.219 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.220 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.221 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.222 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-09-12T02:09:10.223 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.224 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.225 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-09-12T02:09:10.226 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.227 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.228 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.229 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.230 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.231 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-09-12T02:09:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-09-12T02:09:10.233 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.234 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.235 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:09:10.236 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:09:10.237 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.238 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.239 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.240 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.241 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.242 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.243 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.245 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.247 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.248 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-09-12T02:09:10.249 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-09-12T02:09:10.250 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.251 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.253 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.254 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.255 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.256 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.257 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.258 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.259 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.260 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.261 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.262 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:09:10.263 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:09:10.264 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.266 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.268 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.269 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.271 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.272 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.273 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.274 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.275 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.276 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.277 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.278 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:09:10.279 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.283 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.284 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.285 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.286 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.287 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.288 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.289 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.290 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.291 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:09:10.292 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:09:10.293 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:09:10.294 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:09:10.295 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.296 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.298 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.299 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.300 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.302 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.303 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.304 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.306 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.309 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:10.310 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.311 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.312 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.313 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.314 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-09-12T02:09:10.316 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.319 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.320 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.321 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.322 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.325 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-09-12T02:09:10.328 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-09-12T02:09:10.329 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-09-12T02:09:10.330 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.332 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.333 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:09:10.334 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.335 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.336 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.337 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.340 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.341 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.342 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.343 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.344 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.346 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.347 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:09:10.348 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.349 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.350 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.351 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.352 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.353 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.354 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.355 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-09-12T02:09:10.356 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-09-12T02:09:10.357 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.358 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.360 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.361 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.363 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.364 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.365 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.367 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.368 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.370 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.371 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "k8sevents", 2024-09-12T02:09:10.372 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_event_retention_days": { 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:09:10.373 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "config_check_secs": { 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_check_secs", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "10", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:09:10.374 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.375 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.376 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.378 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.379 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-09-12T02:09:10.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.381 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.382 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.383 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.384 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.385 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.387 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.388 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-09-12T02:09:10.389 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.390 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.391 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-09-12T02:09:10.392 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.393 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.394 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.395 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.396 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.397 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.398 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.399 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.401 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.401 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.401 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.404 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.404 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.405 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.406 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.407 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.409 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.410 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.411 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.412 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-09-12T02:09:10.413 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.414 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.415 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.416 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.417 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.418 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.419 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-09-12T02:09:10.420 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.421 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.422 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.423 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.424 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.425 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.426 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.427 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.428 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.429 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.432 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-09-12T02:09:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-09-12T02:09:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:09:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-09-12T02:09:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-09-12T02:09:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.524 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.525 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.526 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.529 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.530 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.531 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.532 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.533 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.535 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.536 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.537 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.538 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.539 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.540 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.543 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.544 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-09-12T02:09:10.545 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-09-12T02:09:10.546 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-09-12T02:09:10.547 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.548 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.551 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.552 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.553 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.555 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.556 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.557 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.558 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.559 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.560 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.561 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.562 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.563 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.564 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:09:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.567 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.568 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.569 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.570 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.571 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.572 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.573 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.577 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.578 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-09-12T02:09:10.579 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.580 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.581 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-09-12T02:09:10.582 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.583 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.584 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.585 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.586 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-09-12T02:09:10.587 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-09-12T02:09:10.588 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-09-12T02:09:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-09-12T02:09:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.591 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-09-12T02:09:10.592 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-09-12T02:09:10.593 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.594 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "services": { 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "dashboard": "https://172.21.15.100:8443/" 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "always_on_modules": { 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus": [ 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:09:10.595 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific": [ 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:09:10.596 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy": [ 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:09:10.597 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "reef": [ 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-12T02:09:10.598 INFO:teuthology.orchestra.run.smithi100.stdout: "squid": [ 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.599 INFO:teuthology.orchestra.run.smithi100.stdout: "last_failure_osd_epoch": 3, 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "active_clients": [ 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2993804054 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "libcephsqlite", 2024-09-12T02:09:10.600 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3119186302 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:09:10.601 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2222146367 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:0", 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1350101913 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:10.602 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T02:09:10.603 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:09:10.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:09 smithi117 ceph-mon[35240]: pgmap v395: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-12T02:09:10.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:09 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/3313163440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:09 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/767118982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.604 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:09 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2519509534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:09 smithi189 ceph-mon[35188]: pgmap v395: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-12T02:09:10.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:09 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/3313163440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:09 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/767118982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:09 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2519509534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:10 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/4085522041' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:09:10.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.194+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9bf80a2b90 msgr2=0x7f9bf80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:10.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.194+0000 7f9c119cf640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9bf80a2b90 0x7f9bf80a5050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc005fd0 tx=0x7f9bfc005850 comp rx=0 tx=0).stop 2024-09-12T02:09:10.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.194+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c102d20 msgr2=0x7f9c0c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.194+0000 7f9c119cf640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c102d20 0x7f9c0c0745e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400d770 tx=0x7f9bf400dc30 comp rx=0 tx=0).stop 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 shutdown_connections 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f9bf80a2b90 0x7f9bf80a5050 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c1036e0 0x7f9c0c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c0c102d20 0x7f9c0c0745e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 --2- 172.21.15.100:0/4085522041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c0c101b30 0x7f9c0c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 >> 172.21.15.100:0/4085522041 conn(0x7f9c0c0fd270 msgr2=0x7f9c0c106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 shutdown_connections 2024-09-12T02:09:10.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:09.195+0000 7f9c119cf640 1 -- 172.21.15.100:0/4085522041 wait complete. 2024-09-12T02:09:10.661 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T02:09:10.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T02:09:10.661 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:09 smithi100 ceph-mon[31179]: pgmap v395: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-12T02:09:10.662 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:09 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/3313163440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.662 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:09 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/767118982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.662 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:09 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2519509534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:09:10.662 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:10 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4085522041' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:09:10.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:10 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/4085522041' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:09:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:11.305 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:11 smithi100 ceph-mon[31179]: pgmap v396: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:11.407 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:09:11.407 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:11.407 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:11.407 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:11.407 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.001310276, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000344092, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 5, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 57, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3232, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 88720, 2024-09-12T02:09:11.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 3, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.006691654, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.003041705, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.003176083, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 56, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.006699962, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000119642 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:11.410 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 88720 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 76, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 73, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 437264, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 43712, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.012229936, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.004308229, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.012021528, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 72, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003563946, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000049499 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 437264, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 43712 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:11.413 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:11.414 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:11.415 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148823, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 27, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:11.416 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:11.417 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 77, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 426585, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 77, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 77, 2024-09-12T02:09:11.418 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 426585, 2024-09-12T02:09:11.419 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:09:11.419 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:11.419 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:11.419 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:11.419 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:11.419 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:11.419 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:09:11.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:11 smithi189 ceph-mon[35188]: pgmap v396: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:11.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:11 smithi117 ceph-mon[35240]: pgmap v396: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:12.061 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-12T02:09:12.061 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-12T02:09:12.061 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-12T02:09:12.062 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-12T02:09:12.062 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T02:09:12.062 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T02:09:12.307 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:12.795 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:09:12.795 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:12.795 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 85, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 80, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 441696, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 47360, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.015417605, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.005129779, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.013165214, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 80, 2024-09-12T02:09:12.796 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.007776525, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000097206 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 441696, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 47360 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 59, 2024-09-12T02:09:12.797 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 88976, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 3, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.004513453, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.002883618, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001082075, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 57, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002519193, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000044196 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:12.798 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 88976 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:12.799 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.000224303, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000168258, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:12.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:12.801 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:12.802 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148841, 2024-09-12T02:09:12.804 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 28, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:12.805 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 82, 2024-09-12T02:09:12.806 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 427235, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 82, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 82, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 427235, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:12.807 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:09:13.483 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:13 smithi100 ceph-mon[31179]: pgmap v397: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:13.509 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T02:09:13.510 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T02:09:13.510 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-12T02:09:13.510 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-12T02:09:13.510 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T02:09:13.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T02:09:13.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:13 smithi189 ceph-mon[35188]: pgmap v397: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:13.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:13 smithi117 ceph-mon[35240]: pgmap v397: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:13.754 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 77, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 74, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 437536, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 44352, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.013105611, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.004576134, 2024-09-12T02:09:14.171 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.011204302, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 73, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003454114, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000047316 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 437536, 2024-09-12T02:09:14.172 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 44352 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 56, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 88448, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 3, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.004619120, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.002741572, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001349259, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:14.173 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 54, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002557070, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000047353 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 88448 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:14.174 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 4, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3072, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 448, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.002159210, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000049130, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002093883, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003861207, 2024-09-12T02:09:14.175 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001287069 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.176 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:14.177 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:14.178 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148840, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 28, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:14.179 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:14.180 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 78, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 426715, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 78, 2024-09-12T02:09:14.181 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 78, 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 426715, 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:14.182 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:09:14.962 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T02:09:14.962 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T02:09:14.962 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-12T02:09:14.962 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-12T02:09:14.962 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T02:09:14.963 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:15 smithi100 ceph-mon[31179]: pgmap v398: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:09:15.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:15 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:15.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:15 smithi189 ceph-mon[35188]: pgmap v398: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:09:15.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:15 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:15.649 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:15 smithi117 ceph-mon[35240]: pgmap v398: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:09:15.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:15 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 86, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 81, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 441968, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 48000, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.015449400, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.004941217, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.013626862, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 81, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.008126596, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000100328 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 441968, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 48000 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 60, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 89152, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 3, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.005112621, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.003201852, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001367031, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 58, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002301658, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000039683 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 89152 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.000357536, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000291736, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148880, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 29, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 83, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 427365, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 83, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 83, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 427365, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T02:09:16.370 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T02:09:16.370 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T02:09:16.370 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-12T02:09:16.370 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-12T02:09:16.370 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T02:09:16.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T02:09:16.619 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:16 smithi117 ceph-mon[35240]: pgmap v399: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T02:09:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:16.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:16.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:16 smithi100 ceph-mon[31179]: pgmap v399: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' 2024-09-12T02:09:16.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:16 smithi189 ceph-mon[35188]: pgmap v399: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 9058, 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 5240, 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 3025161, 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 4942187, 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 34, 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 5, 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.422398426, 2024-09-12T02:09:17.290 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.172602403, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.280859955, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.034871585, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5238, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.792687883, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000151334 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 11621, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.001323500, 2024-09-12T02:09:17.291 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000113 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 933, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 783, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 758075, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 585610, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 30, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 8, 2024-09-12T02:09:17.292 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.092557186, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.025089821, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.043867236, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.022772748, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 782, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.361738620, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000462581 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 304, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000047279, 2024-09-12T02:09:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000155 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 579216, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 90480 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 2315, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 3717, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 827932, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 1781371, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 12, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 6, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.193075746, 2024-09-12T02:09:17.294 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.078057760, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.118478992, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.019755966, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3716, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.677822989, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000182406 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4631, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000754122, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000162 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.295 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 587104, 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 1332416 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1454, 2024-09-12T02:09:17.296 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.604115477, 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000415485 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1229, 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.049360810, 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000040163 2024-09-12T02:09:17.297 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.298 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-12T02:09:17.298 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 726, 2024-09-12T02:09:17.298 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 724, 2024-09-12T02:09:17.298 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-12T02:09:17.298 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 724, 2024-09-12T02:09:17.298 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.878398951, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001213258 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 2, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 2, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 1, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 48, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 26, 2024-09-12T02:09:17.299 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 6, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 9, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 11, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 17, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 290, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 1, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 1, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 3, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 834, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 809, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 1, 2024-09-12T02:09:17.300 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 2, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 2, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 2, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 1, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 36, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 4, 2024-09-12T02:09:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 234, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 36, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 24, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 3, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 21, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 12, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 4, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 35, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 912, 2024-09-12T02:09:17.302 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 631, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 301, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 8, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 344 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 13, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 0, 2024-09-12T02:09:17.303 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 25, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 301, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 301, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:17.304 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 1, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 12, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 3, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 2, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.305 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 1570, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 1185, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 1185, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 385, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 1129, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 10, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 9, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 9, 2024-09-12T02:09:17.306 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 1, 2024-09-12T02:09:17.307 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 1, 2024-09-12T02:09:17.307 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-12T02:09:17.307 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 2, 2024-09-12T02:09:17.307 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 6650937, 2024-09-12T02:09:17.307 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 7445009, 2024-09-12T02:09:17.307 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 0, 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 649, 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.002889517, 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001545284 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 0 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.308 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 26, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 620, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 594, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 21, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 28, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 7, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 26, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 623, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 597, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 1, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 316, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 315, 2024-09-12T02:09:17.309 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 56608, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 231712 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 996, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 1822, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 726, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 12, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 3648, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 300, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.237913947, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000793046 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.310 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 89, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.031690180, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000356069 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.311 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.001302003, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000260400 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.312 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:17.313 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.314 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.314 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.314 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-12T02:09:17.314 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.314 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 12, 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.017261502, 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001438458 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.315 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1, 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000202345, 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000202345 2024-09-12T02:09:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.002859045, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000571809 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.001968781, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000984390 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.317 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 6, 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.031863863, 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.005310643 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:17.318 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.001729297, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001729297 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.319 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.320 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 8, 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.020783298, 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.002597912 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.321 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 295, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.530824690, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001799405 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:17.322 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 2, 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 1, 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 1, 2024-09-12T02:09:17.323 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 552, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 552, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 151, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:17.324 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:17.325 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:17.326 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 304935, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 115, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 176, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 2, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:17.327 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 7496, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 154, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 107698, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 707, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:17.328 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 2253, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 3363265, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 37, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 2253, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2253, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 23.036527970, 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.010224823 2024-09-12T02:09:17.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2253, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 2419 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 2253, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 57, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 2196, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 28, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 30, 2024-09-12T02:09:17.330 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 15, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 661, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 45, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 1373, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 42, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 60, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:17.331 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-12T02:09:17.332 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 82, 2024-09-12T02:09:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 12, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 12, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 141, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 6, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 18 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 1, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-12T02:09:17.334 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "osd-slow-ops": { 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 13 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 14, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 8, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 861, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 301, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 12302, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 3408033, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 12302, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 12302, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 3408033, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.336 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:17.337 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 2253, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 3393630, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 2253, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 3393630, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:17.338 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 2253, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 2253, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 2253, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 2253, 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:17.339 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 301, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 30401, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 301, 2024-09-12T02:09:17.340 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 12, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 30401, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x55daf93ac960": { 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:17.341 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 1570, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 3250705, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 1570, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 649, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 3250705, 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:17.342 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:17.343 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:09:18.134 INFO:tasks.check_counter:Daemon mds.b mds.exported=2 2024-09-12T02:09:18.135 INFO:tasks.check_counter:Daemon mds.b mds.imported=2 2024-09-12T02:09:18.135 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=13 2024-09-12T02:09:18.135 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-12T02:09:18.135 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T02:09:18.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T02:09:18.394 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:18.864 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:09:18.864 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:18.864 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 219, 2024-09-12T02:09:18.864 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 221, 2024-09-12T02:09:18.864 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 4252129, 2024-09-12T02:09:18.864 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 69706, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 6, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.022770911, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.007816794, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.007137444, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.004997976, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 219, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.010416965, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000047566 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:18.865 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 233, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 226, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 2325980, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 93261, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:18.866 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.028038186, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.009388759, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.018696885, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.004044501, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 225, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.011223960, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000049884 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.867 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 470368, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 48736 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 285, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 341, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 93892, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 265312, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:18.868 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 4, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.038093268, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.012424818, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.011375922, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.010718469, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 340, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.023019978, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000067705 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.869 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 176272 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1121, 2024-09-12T02:09:18.870 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.031588208, 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000028178 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-12T02:09:18.871 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-12T02:09:18.872 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 917, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 917, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 917, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 1, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:18.873 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-12T02:09:18.874 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:18.875 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 0 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:18.876 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 0, 2024-09-12T02:09:18.877 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 4574, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-12T02:09:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 0, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 0, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 0, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 0, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 7, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 2, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 0, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 4194304, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 10209006, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 10207868, 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-12T02:09:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 4574 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 9, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 935, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 926, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 7, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 22, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 15, 2024-09-12T02:09:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 917, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 933, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 16, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 0, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 0, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 0, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 50624, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 215328 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 0, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 0, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 0, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 0, 2024-09-12T02:09:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 0, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.883 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.884 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.885 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-12T02:09:18.886 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.887 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.887 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.887 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-12T02:09:18.887 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:18.890 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.892 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-12T02:09:18.893 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-12T02:09:18.894 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 1, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 0, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 1, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 0, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 0, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 1378, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:18.895 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:18.896 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:18.897 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 197319, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 52, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:09:18.898 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 7496, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 154, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 675144, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 3752, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 639, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 21, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 3, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 639, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 639, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.364992529, 2024-09-12T02:09:18.900 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000571193 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 639, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 640 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 639, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 639, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 0, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 374, 2024-09-12T02:09:18.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 263, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 1, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 0, 2024-09-12T02:09:18.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-12T02:09:18.903 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-12T02:09:18.904 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 82, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 6, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 6, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-12T02:09:18.905 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 0, 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 2, 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 0 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 0, 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.906 INFO:teuthology.orchestra.run.smithi117.stdout: "osd-slow-ops": { 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 0 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 0, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 0, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 0, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:18.907 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 733, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 6598220, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 733, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 733, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 6598220, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.908 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 639, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 6014707, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 639, 2024-09-12T02:09:18.909 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 6014707, 2024-09-12T02:09:18.910 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:18.910 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.910 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.910 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 639, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 639, 2024-09-12T02:09:18.915 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 639, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 639, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:18.916 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x5579c9010b40": { 2024-09-12T02:09:18.917 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:18.918 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:18.919 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:18.919 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.919 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:18.919 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:09:19.399 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:19 smithi117 ceph-mon[35240]: pgmap v400: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:19.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:19 smithi100 ceph-mon[31179]: pgmap v400: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:19.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:19 smithi189 ceph-mon[35188]: pgmap v400: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:19.769 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T02:09:19.770 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T02:09:19.770 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-12T02:09:19.770 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-12T02:09:19.770 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T02:09:19.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T02:09:20.017 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 5863, 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 9672, 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 1883882, 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 7547774, 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 10, 2024-09-12T02:09:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.477478126, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.221241394, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.225337029, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.047075996, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 9674, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.206687608, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000021365 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 11313, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.002327913, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000205 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 480080, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 53552 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 1623, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 1680, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 408264, 2024-09-12T02:09:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 2678804, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 14, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 6, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.121724875, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.042625046, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.028802323, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.038941328, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1678, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.089183982, 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000053148 2024-09-12T02:09:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 6, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000548, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000091 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 177328 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 4776, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 8416, 2024-09-12T02:09:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 1876095, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 3806925, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 13, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 7, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.360014563, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.158361201, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.223386297, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.030374590, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 8412, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.202913460, 2024-09-12T02:09:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000024121 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 9366, 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.001407027, 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000150 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 1497440, 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 3297376 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:09:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3677, 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.376147306, 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000374258 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-12T02:09:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-12T02:09:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3826, 2024-09-12T02:09:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.166254996, 2024-09-12T02:09:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000043453 2024-09-12T02:09:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 1824, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 1823, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1823, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 2.656481129, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001457203 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 1, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-12T02:09:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 11, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 18, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 2, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 16, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 0, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 13, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 9, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 1, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 1, 2024-09-12T02:09:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 3, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 3952, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 1832, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 0, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 4, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 0, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 2, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 1, 2024-09-12T02:09:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 2, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 2, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 1, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 5, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 234, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 1, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 1, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 3, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 2731, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 1825, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 913, 2024-09-12T02:09:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 8, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 1822 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 1, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 18, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 11, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 12, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 1, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 911, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 911, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 1, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 5, 2024-09-12T02:09:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 2, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 4574, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 0, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 0, 2024-09-12T02:09:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 4574, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 0, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 7, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 0, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 0, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 7, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 2, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 0, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 4194304, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 10209006, 2024-09-12T02:09:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 0, 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1811, 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 2.682374475, 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001481156 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 0 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 22, 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 940, 2024-09-12T02:09:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 918, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 21, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 28, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 7, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 18, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 939, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 921, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 1, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 914, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 913, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 58172, 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 223520 2024-09-12T02:09:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 4951, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 1, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 1824, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 4, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 1824, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 910, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.754240641, 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000828835 2024-09-12T02:09:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1, 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000126278, 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000126278 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-12T02:09:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1, 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000377896, 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000377896 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-12T02:09:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-12T02:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 911, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.901736314, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.002087526 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 1, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 0, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 1, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-12T02:09:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 1703, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 1703, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 133, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 289799, 2024-09-12T02:09:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 108, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 440, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 5, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 7496, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 154, 2024-09-12T02:09:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 90397, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 408, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-12T02:09:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 4565, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 6193941, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 28, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 4565, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4565, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 9.108813153, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001995358 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-12T02:09:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4565, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 4608 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 4565, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 25, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 4540, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 0, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 10, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 24, 2024-09-12T02:09:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 1835, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 17, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 2650, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 1, 2024-09-12T02:09:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 20, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-12T02:09:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-12T02:09:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 82, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 12, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 12, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 43, 2024-09-12T02:09:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 0, 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 8 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 1, 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "osd-slow-ops": { 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 6 2024-09-12T02:09:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 12, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 5, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 2637, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 911, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 12258, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 2860317, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 12258, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 12258, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 2860317, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 4565, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 6285952, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 4565, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 6285952, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 4565, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 4565, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 4565, 2024-09-12T02:09:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 4565, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 911, 2024-09-12T02:09:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 92011, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 911, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 24, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 92011, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x55b405798960": { 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 4574, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 6014702, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 4574, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 1811, 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 6014702, 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:20.642 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:09:21.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:21 smithi117 ceph-mon[35240]: pgmap v401: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:21.477 INFO:tasks.check_counter:Daemon mds.h mds.exported=2 2024-09-12T02:09:21.477 INFO:tasks.check_counter:Daemon mds.h mds.imported=2 2024-09-12T02:09:21.477 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=1 2024-09-12T02:09:21.477 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=18 2024-09-12T02:09:21.477 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T02:09:21.477 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T02:09:21.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:21 smithi100 ceph-mon[31179]: pgmap v401: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:21.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:21 smithi189 ceph-mon[35188]: pgmap v401: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:21.720 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:22.203 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T02:09:22.203 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:22.203 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 4, 2024-09-12T02:09:22.203 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 4, 2024-09-12T02:09:22.203 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 3072, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 448, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.002882125, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.000031446, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.002087946, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.003921807, 2024-09-12T02:09:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001307269 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 1, 2024-09-12T02:09:22.205 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 62, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 89504, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 3, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.004616679, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.002864490, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.000968956, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 60, 2024-09-12T02:09:22.206 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.003961055, 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000066017 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 89504 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.207 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 85, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 82, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 439712, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 49472, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.014432860, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.005750339, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.012477233, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:22.208 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 81, 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.005669896, 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000069998 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 439712, 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 49472 2024-09-12T02:09:22.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 0, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:22.210 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:22.211 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:22.212 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 148823, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 27, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:22.213 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:22.214 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 2, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 86, 2024-09-12T02:09:22.215 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 427755, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 86, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 86, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 427755, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.216 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:22.217 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-12T02:09:22.217 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T02:09:22.800 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-12T02:09:22.800 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-12T02:09:22.800 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-12T02:09:22.800 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-12T02:09:22.800 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T02:09:22.800 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T02:09:23.066 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:23.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:23 smithi117 ceph-mon[35240]: pgmap v402: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:23.453 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:23 smithi189 ceph-mon[35188]: pgmap v402: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:23.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:23 smithi100 ceph-mon[31179]: pgmap v402: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 534, 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 536, 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 3408872, 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 169822, 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.054289843, 2024-09-12T02:09:23.795 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.016733339, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.016236110, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.015788401, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 534, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.021653660, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000040549 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.796 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 5, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 63, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1816, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 178778, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.005243605, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.002476699, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001874486, 2024-09-12T02:09:23.797 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000118776, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 61, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.007996683, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000131093 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 177440 2024-09-12T02:09:23.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 337, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 328, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 532465, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 125347, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.039632267, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.014131554, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.020494178, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.007203297, 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:23.799 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 328, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.018495045, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000056387 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 473600, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 49344 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:09:23.800 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1282, 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.036970317, 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000028838 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:09:23.801 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.802 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 318, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 164, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 154, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 83, 2024-09-12T02:09:23.803 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 2, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T02:09:23.804 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:23.805 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-12T02:09:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:23.807 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T02:09:23.808 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 1570, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T02:09:23.809 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 9, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 6650937, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 7445009, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 7443871, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.810 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 1570 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 17, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 320, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 303, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 12, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 18, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 6, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 318, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 326, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 8, 2024-09-12T02:09:23.811 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 49144, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T02:09:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.813 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.814 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:23.815 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.816 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T02:09:23.817 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.817 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.817 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.817 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.817 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.819 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.821 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.822 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.823 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.824 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 2, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 2494, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:09:23.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:23.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:23.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 189239, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 48, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:23.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7496, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 154, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 277242, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 1495, 2024-09-12T02:09:23.829 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 777, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 26, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 4, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 777, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 777, 2024-09-12T02:09:23.830 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.384992193, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000495485 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 777, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 778 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 777, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 777, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 485, 2024-09-12T02:09:23.831 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 289, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 2, 2024-09-12T02:09:23.832 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T02:09:23.833 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T02:09:23.834 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 82, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 5, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 5, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-12T02:09:23.835 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T02:09:23.836 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 872, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 3856816, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 872, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:23.837 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 872, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 3856816, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:23.838 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 777, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 3250715, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 777, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 3250715, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.839 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 777, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 777, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 777, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 777, 2024-09-12T02:09:23.840 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:23.841 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x55c34d528b40": { 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:23.842 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:23.843 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:09:24.773 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T02:09:24.774 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T02:09:24.774 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-12T02:09:24.774 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-12T02:09:24.774 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T02:09:24.774 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T02:09:25.030 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:25.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:25 smithi189 ceph-mon[35188]: pgmap v403: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:09:25.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:25 smithi117 ceph-mon[35240]: pgmap v403: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:09:25.544 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:09:25.544 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:25.544 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 347, 2024-09-12T02:09:25.544 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 338, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 557376, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 129006, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.048860064, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.015626794, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.024056611, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.009889143, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 338, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.025288769, 2024-09-12T02:09:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000074818 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 473712, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 49824 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 63, 2024-09-12T02:09:25.546 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 716, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 259050, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.005277093, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.002757074, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001708923, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000073393, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 61, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.005347391, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000087662 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:25.547 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 258352 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 416, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 418, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 108395, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 132295, 2024-09-12T02:09:25.548 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.032860146, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.011177340, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.008893000, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.010238831, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 416, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.017345557, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000041696 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.549 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:09:25.550 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1166, 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.032477840, 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000027854 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T02:09:25.552 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 1, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-12T02:09:25.553 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:25.554 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:09:25.555 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-12T02:09:25.556 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:25.557 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T02:09:25.558 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 5, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T02:09:25.559 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195734, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4195593, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 5 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 3, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 3, 2024-09-12T02:09:25.560 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 1, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 1, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 47848, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.561 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.562 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.563 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T02:09:25.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.565 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T02:09:25.566 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.566 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.566 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.566 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.566 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T02:09:25.566 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.566 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.567 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T02:09:25.568 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.569 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:25.571 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.572 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:25.573 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 2, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-12T02:09:25.574 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 2492, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:25.575 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:25.576 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:25.577 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 181199, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 45, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7496, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 154, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:25.578 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 8512, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 13, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T02:09:25.579 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 667, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 667, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 667, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.348992918, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000523227 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 667, 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 668 2024-09-12T02:09:25.580 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 667, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 667, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 409, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 256, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T02:09:25.581 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T02:09:25.582 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T02:09:25.583 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 82, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 4, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 4, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-12T02:09:25.584 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-12T02:09:25.585 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:09:25.586 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 762, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 590044, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 762, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 762, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 590044, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.587 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 667, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 1435, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 667, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1435, 2024-09-12T02:09:25.588 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:25.589 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 667, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 667, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 667, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 667, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:25.590 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.591 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x56460a5b0b40": { 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:09:25.592 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:09:25.593 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:25.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:25.593 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:25.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:25.593 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.593 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:25.593 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:09:25.593 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:25 smithi100 ceph-mon[31179]: pgmap v403: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T02:09:26.401 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T02:09:26.401 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T02:09:26.401 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-12T02:09:26.401 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-12T02:09:26.401 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T02:09:26.401 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T02:09:26.649 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:27.173 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:09:27.173 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:27.173 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 784, 2024-09-12T02:09:27.173 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 501, 2024-09-12T02:09:27.173 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 236467, 2024-09-12T02:09:27.173 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 157799, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 9, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.053957144, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.019546955, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.037640816, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.002240316, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 499, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.028690926, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000057496 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.174 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1223, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000219422, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000179 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 156, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 144, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 495266, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 163445, 2024-09-12T02:09:27.175 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 15, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.022787764, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.006471209, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.020319823, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000222840, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 144, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.019582791, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000135991 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 28, 2024-09-12T02:09:27.176 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000004237, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000151 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 486368, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 56048 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 23, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 81, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 5711, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 240846, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 11, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T02:09:27.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.010724321, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.003725695, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.005571273, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000540105, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 79, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.021267964, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000269214 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 20, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000003153, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000157 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 182400 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 55, 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001483344, 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000026969 2024-09-12T02:09:27.179 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000027287, 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000013643 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 6, 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 4, 2024-09-12T02:09:27.180 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 4, 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.671748558, 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.167937139 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 2, 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T02:09:27.181 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 11, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 18, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 2, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 16, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 13, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 8, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 1, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 1, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 3, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 24, 2024-09-12T02:09:27.182 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 14, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 1, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 5, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 1, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T02:09:27.183 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 5, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:27.184 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 2, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 1, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 2, 2024-09-12T02:09:27.185 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 1, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 1 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 18, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 11, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 14, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T02:09:27.186 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:27.187 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 1, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 5, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:27.188 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 5, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 5, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T02:09:27.189 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 2, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195734, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 4, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.006727526, 2024-09-12T02:09:27.190 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001681881 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 22, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 28, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 6, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 21, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 27, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 6, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 18, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 26, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 8, 2024-09-12T02:09:27.191 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 1, 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 4, 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 3, 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 50316, 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 223520 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 8, 2024-09-12T02:09:27.192 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 1, 2024-09-12T02:09:27.193 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 6, 2024-09-12T02:09:27.193 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 8, 2024-09-12T02:09:27.193 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 2, 2024-09-12T02:09:27.193 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000185601, 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000185601 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:27.194 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-12T02:09:27.195 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.671305944, 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.335652972 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-12T02:09:27.196 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000257013, 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000257013 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.197 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T02:09:27.198 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.199 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.199 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.199 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.200 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T02:09:27.201 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.201 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.201 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.201 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.201 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T02:09:27.201 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.202 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.203 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.204 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.204 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:27.204 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.204 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.204 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.204 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.204 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.205 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.207 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.208 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 2, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 2, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 157, 2024-09-12T02:09:27.209 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:27.210 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:27.211 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:27.212 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 259519, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 90, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:27.213 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7496, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 154, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:27.214 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 89741, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 358, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T02:09:27.215 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 44, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 12347, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 30, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 44, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 44, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.206995824, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.004704450 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.216 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 44, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 70 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 44, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 0, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 44, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 0, 2024-09-12T02:09:27.217 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 10, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 0, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 4, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 7, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 6, 2024-09-12T02:09:27.218 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 20, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:27.219 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T02:09:27.220 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 82, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-12T02:09:27.221 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 10, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 10, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 20, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 0, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 3 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T02:09:27.222 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 6 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T02:09:27.223 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 959, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 641165, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 959, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 959, 2024-09-12T02:09:27.224 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 641165, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:27.225 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 44, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 12347, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 44, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 12347, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:27.226 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 44, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 44, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 44, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 44, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.227 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:27.228 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x55ecf6a3a960": { 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 5, 2024-09-12T02:09:27.229 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1430, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 5, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 4, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1430, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:27.230 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:09:27.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:27 smithi189 ceph-mon[35188]: pgmap v404: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T02:09:27.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:27 smithi117 ceph-mon[35240]: pgmap v404: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T02:09:27.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:27 smithi100 ceph-mon[31179]: pgmap v404: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T02:09:27.774 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-12T02:09:27.774 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-12T02:09:27.774 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-12T02:09:27.774 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=18 2024-09-12T02:09:27.774 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T02:09:27.775 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T02:09:28.020 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:28.552 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T02:09:28.552 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:28.552 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 91, 2024-09-12T02:09:28.552 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 86, 2024-09-12T02:09:28.552 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 443328, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 51200, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.018001174, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.005913091, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.016212176, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 86, 2024-09-12T02:09:28.553 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.009674278, 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000112491 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 443328, 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 51200 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.554 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1, 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 64, 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 89856, 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.004379779, 2024-09-12T02:09:28.555 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.003010757, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000727408, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 62, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.002534754, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000040883 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:28.556 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 89856 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.000319430, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:28.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000256566, 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:28.558 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:28.559 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:28.560 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:28.561 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:28.562 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148863, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 28, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:28.563 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:28.564 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 88, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 428015, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:28.565 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 88, 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 88, 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 428015, 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T02:09:28.566 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T02:09:29.258 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-12T02:09:29.258 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-12T02:09:29.258 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-12T02:09:29.258 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-12T02:09:29.258 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:09:29.269 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:09:29.269 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:09:29.269 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:09:29.290 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T02:09:29.290 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:09:29.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:09:29.415 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:29 smithi100 ceph-mon[31179]: pgmap v405: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:29.592 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:29 smithi189 ceph-mon[35188]: pgmap v405: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:29.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:29 smithi117 ceph-mon[35240]: pgmap v405: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:29.653 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 -- 172.21.15.100:0/242097932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c102d50 msgr2=0x7f121c103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 --2- 172.21.15.100:0/242097932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c102d50 0x7f121c103130 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1210009900 tx=0x7f121002a480 comp rx=0 tx=0).stop 2024-09-12T02:09:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 -- 172.21.15.100:0/242097932 shutdown_connections 2024-09-12T02:09:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 --2- 172.21.15.100:0/242097932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c10c180 0x7f121c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 --2- 172.21.15.100:0/242097932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c103670 0x7f121c10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 --2- 172.21.15.100:0/242097932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c102d50 0x7f121c103130 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 -- 172.21.15.100:0/242097932 >> 172.21.15.100:0/242097932 conn(0x7f121c0fc7d0 msgr2=0x7f121c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 -- 172.21.15.100:0/242097932 shutdown_connections 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.113+0000 7f1223036640 1 -- 172.21.15.100:0/242097932 wait complete. 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 Processor -- start 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 -- start start 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102d50 0x7f121c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c103670 0x7f121c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c10c180 0x7f121c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f121c111f80 con 0x7f121c103670 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f121c111e00 con 0x7f121c10c180 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1223036640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f121c112100 con 0x7f121c102d50 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f121bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c103670 0x7f121c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f121bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c103670 0x7f121c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46296/0 (socket says 172.21.15.100:46296) 2024-09-12T02:09:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f121bfff640 1 -- 172.21.15.100:0/811704404 learned_addr learned my addr 172.21.15.100:0/811704404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f1220dd2640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102d50 0x7f121c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.114+0000 7f12215d3640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c10c180 0x7f121c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f121bfff640 1 -- 172.21.15.100:0/811704404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102d50 msgr2=0x7f121c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f121bfff640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102d50 0x7f121c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f121bfff640 1 -- 172.21.15.100:0/811704404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c10c180 msgr2=0x7f121c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f121bfff640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c10c180 0x7f121c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f121bfff640 1 -- 172.21.15.100:0/811704404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c19d430 con 0x7f121c103670 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f121bfff640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c103670 0x7f121c1989c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f120800c940 tx=0x7f120800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f1219ffb640 1 -- 172.21.15.100:0/811704404 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208004220 con 0x7f121c103670 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f1219ffb640 1 -- 172.21.15.100:0/811704404 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12080043c0 con 0x7f121c103670 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121c19d720 con 0x7f121c103670 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f1219ffb640 1 -- 172.21.15.100:0/811704404 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208004a00 con 0x7f121c103670 2024-09-12T02:09:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.115+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121c1a5000 con 0x7f121c103670 2024-09-12T02:09:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.116+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121c103130 con 0x7f121c103670 2024-09-12T02:09:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.118+0000 7f1219ffb640 1 -- 172.21.15.100:0/811704404 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f12080079b0 con 0x7f121c103670 2024-09-12T02:09:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.119+0000 7f1219ffb640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f120c0a2c00 0x7f120c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.119+0000 7f1220dd2640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f120c0a2c00 0x7f120c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.119+0000 7f1219ffb640 1 -- 172.21.15.100:0/811704404 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12080cef80 con 0x7f121c103670 2024-09-12T02:09:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.119+0000 7f1220dd2640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f120c0a2c00 0x7f120c0a50c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1210009230 tx=0x7f12100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.123+0000 7f1219ffb640 1 -- 172.21.15.100:0/811704404 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1208014030 con 0x7f121c103670 2024-09-12T02:09:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.309+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f121c106c90 con 0x7f121c103670 2024-09-12T02:09:30.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.309+0000 7f1219ffb640 1 -- 172.21.15.100:0/811704404 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+600 (secure 0 0 0) 0x7f120809bef0 con 0x7f121c103670 2024-09-12T02:09:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3840981165 2024-09-13T01:58:21.937252+0000 2024-09-12T02:09:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2411453195 2024-09-13T01:58:21.937252+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/824408405 2024-09-13T01:58:21.937252+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2932456441 2024-09-13T01:57:58.286368+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/824408405 2024-09-13T01:58:21.937252+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2932456441 2024-09-13T01:57:58.286368+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1570268784 2024-09-13T01:57:58.286368+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1018467611 2024-09-13T01:57:58.286368+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3007182945 2024-09-13T01:58:21.937252+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4194493962 2024-09-13T01:57:58.286368+0000 2024-09-12T02:09:30.310 INFO:teuthology.orchestra.run.smithi100.stderr:listed 10 entries 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f120c0a2c00 msgr2=0x7f120c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f120c0a2c00 0x7f120c0a50c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1210009230 tx=0x7f12100058d0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c103670 msgr2=0x7f121c1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c103670 0x7f121c1989c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f120800c940 tx=0x7f120800ce00 comp rx=0 tx=0).stop 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 shutdown_connections 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f120c0a2c00 0x7f120c0a50c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f121c10c180 0x7f121c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f121c103670 0x7f121c1989c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 --2- 172.21.15.100:0/811704404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f121c102d50 0x7f121c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:30.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 >> 172.21.15.100:0/811704404 conn(0x7f121c0fc7d0 msgr2=0x7f121c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:30.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 shutdown_connections 2024-09-12T02:09:30.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:30.312+0000 7f1223036640 1 -- 172.21.15.100:0/811704404 wait complete. 2024-09-12T02:09:31.038 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:09:31.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:31.038 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:09:31.123 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:09:31.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:31.124 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:09:31.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:31.166 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-12T02:09:31.222 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:09:31.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:31.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:09:31.284 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:31 smithi100 ceph-mon[31179]: pgmap v406: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:31.284 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:31 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/811704404' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:09:31.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:31.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-12T02:09:31.386 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T02:09:31.422 INFO:tasks.cephadm:Teardown begin 2024-09-12T02:09:31.422 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:09:31.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:09:31.452 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:31 smithi117 ceph-mon[35240]: pgmap v406: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:31.453 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:31 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/811704404' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:09:31.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:31 smithi189 ceph-mon[35188]: pgmap v406: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:09:31.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:31 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/811704404' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:09:31.670 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:32.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 -- 172.21.15.100:0/3827181676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 msgr2=0x7fd20c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:32.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 --2- 172.21.15.100:0/3827181676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c101200 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009ca0 tx=0x7fd1fc02a950 comp rx=0 tx=0).stop 2024-09-12T02:09:32.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 -- 172.21.15.100:0/3827181676 shutdown_connections 2024-09-12T02:09:32.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 --2- 172.21.15.100:0/3827181676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd20c102ef0 0x7fd20c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 --2- 172.21.15.100:0/3827181676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd20c102570 0x7fd20c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 --2- 172.21.15.100:0/3827181676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c101200 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 -- 172.21.15.100:0/3827181676 >> 172.21.15.100:0/3827181676 conn(0x7fd20c0fc7d0 msgr2=0x7fd20c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 -- 172.21.15.100:0/3827181676 shutdown_connections 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 -- 172.21.15.100:0/3827181676 wait complete. 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 Processor -- start 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.187+0000 7fd2136fd640 1 -- start start 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd2136fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd2136fd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd20c102570 0x7fd20c103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd2136fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd20c102ef0 0x7fd20c1041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd2136fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c110f80 con 0x7fd20c100e20 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd2136fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c110e00 con 0x7fd20c102ef0 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd2136fd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c111100 con 0x7fd20c102570 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46322/0 (socket says 172.21.15.100:46322) 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 -- 172.21.15.100:0/4040912733 learned_addr learned my addr 172.21.15.100:0/4040912733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 -- 172.21.15.100:0/4040912733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd20c102570 msgr2=0x7fd20c103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211c9a640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd20c102ef0 0x7fd20c1041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd20c102570 0x7fd20c103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 -- 172.21.15.100:0/4040912733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd20c102ef0 msgr2=0x7fd20c1041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd20c102ef0 0x7fd20c1041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 -- 172.21.15.100:0/4040912733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c1a6a20 con 0x7fd20c100e20 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211c9a640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd20c102ef0 0x7fd20c1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd211499640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c103750 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc005cc0 tx=0x7fd1fc02f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd20a7fc640 1 -- 172.21.15.100:0/4040912733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc034040 con 0x7fd20c100e20 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd20a7fc640 1 -- 172.21.15.100:0/4040912733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc030920 con 0x7fd20c100e20 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c1a6cb0 con 0x7fd20c100e20 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.188+0000 7fd20a7fc640 1 -- 172.21.15.100:0/4040912733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc004830 con 0x7fd20c100e20 2024-09-12T02:09:32.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.189+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1a7190 con 0x7fd20c100e20 2024-09-12T02:09:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.189+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c101200 con 0x7fd20c100e20 2024-09-12T02:09:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.191+0000 7fd20a7fc640 1 -- 172.21.15.100:0/4040912733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd1fc037020 con 0x7fd20c100e20 2024-09-12T02:09:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.191+0000 7fd20a7fc640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd1f40a2c00 0x7fd1f40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.191+0000 7fd210c98640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd1f40a2c00 0x7fd1f40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.191+0000 7fd20a7fc640 1 -- 172.21.15.100:0/4040912733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd1fc0f0120 con 0x7fd20c100e20 2024-09-12T02:09:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.192+0000 7fd210c98640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd1f40a2c00 0x7fd1f40a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd200005fd0 tx=0x7fd200005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.194+0000 7fd20a7fc640 1 -- 172.21.15.100:0/4040912733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1fc0bd090 con 0x7fd20c100e20 2024-09-12T02:09:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.395+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd20c1a73c0 con 0x7fd20c100e20 2024-09-12T02:09:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.396+0000 7fd20a7fc640 1 -- 172.21.15.100:0/4040912733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11931 (secure 0 0 0) 0x7fd1fc0bc990 con 0x7fd20c100e20 2024-09-12T02:09:32.396 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:09:32.396 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:08:26:210418+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:08:25.469043+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:09:32.396 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:09:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd1f40a2c00 msgr2=0x7fd1f40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:32.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd1f40a2c00 0x7fd1f40a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd200005fd0 tx=0x7fd200005850 comp rx=0 tx=0).stop 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 msgr2=0x7fd20c103750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c103750 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc005cc0 tx=0x7fd1fc02f650 comp rx=0 tx=0).stop 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 shutdown_connections 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fd1f40a2c00 0x7fd1f40a50c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd20c102ef0 0x7fd20c1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd20c102570 0x7fd20c103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 --2- 172.21.15.100:0/4040912733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd20c100e20 0x7fd20c103750 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 >> 172.21.15.100:0/4040912733 conn(0x7fd20c0fc7d0 msgr2=0x7fd20c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 shutdown_connections 2024-09-12T02:09:32.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:32.398+0000 7fd2136fd640 1 -- 172.21.15.100:0/4040912733 wait complete. 2024-09-12T02:09:33.024 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:09:33.277 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:33.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:33 smithi100 ceph-mon[31179]: pgmap v407: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:33.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:33 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/4040912733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:33 smithi189 ceph-mon[35188]: pgmap v407: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:33.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:33 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/4040912733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:33.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:33 smithi117 ceph-mon[35240]: pgmap v407: 97 pgs: 97 active+clean; 9.5 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:09:33.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:33 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/4040912733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:33.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1990073790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102ef0 msgr2=0x7f1ecc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:33.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1990073790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102ef0 0x7f1ecc10da40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009ca0 tx=0x7f1ec402a950 comp rx=0 tx=0).stop 2024-09-12T02:09:33.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1990073790 shutdown_connections 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1990073790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102ef0 0x7f1ecc10da40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1990073790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc102570 0x7f1ecc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1990073790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ecc100e20 0x7f1ecc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1990073790 >> 172.21.15.100:0/1990073790 conn(0x7f1ecc0fc7d0 msgr2=0x7f1ecc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1990073790 shutdown_connections 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1990073790 wait complete. 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.711+0000 7f1ed1f25640 1 Processor -- start 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ed1f25640 1 -- start start 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ed1f25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc100e20 0x7f1ecc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ed1f25640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102570 0x7f1ecc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ed1f25640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ecc102ef0 0x7f1ecc19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ed1f25640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc110f80 con 0x7f1ecc102570 2024-09-12T02:09:33.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ed1f25640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc110e00 con 0x7f1ecc100e20 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ed1f25640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc111100 con 0x7f1ecc102ef0 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102570 0x7f1ecc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102570 0x7f1ecc198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52426/0 (socket says 172.21.15.100:52426) 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 -- 172.21.15.100:0/1661358311 learned_addr learned my addr 172.21.15.100:0/1661358311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecb7fe640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc100e20 0x7f1ecc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 -- 172.21.15.100:0/1661358311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ecc102ef0 msgr2=0x7f1ecc19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ecc102ef0 0x7f1ecc19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 -- 172.21.15.100:0/1661358311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc100e20 msgr2=0x7f1ecc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc100e20 0x7f1ecc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecaffd640 1 -- 172.21.15.100:0/1661358311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ecc19d4b0 con 0x7f1ecc102570 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.712+0000 7f1ecb7fe640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc100e20 0x7f1ecc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.713+0000 7f1ecaffd640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102570 0x7f1ecc198a40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00d950 tx=0x7f1ebc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:33.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.713+0000 7f1ec8ff9640 1 -- 172.21.15.100:0/1661358311 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc017070 con 0x7f1ecc102570 2024-09-12T02:09:33.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.713+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ecc19d7a0 con 0x7f1ecc102570 2024-09-12T02:09:33.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.713+0000 7f1ec8ff9640 1 -- 172.21.15.100:0/1661358311 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc009c30 con 0x7f1ecc102570 2024-09-12T02:09:33.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.713+0000 7f1ec8ff9640 1 -- 172.21.15.100:0/1661358311 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00f6b0 con 0x7f1ecc102570 2024-09-12T02:09:33.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.713+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ecc1a5080 con 0x7f1ecc102570 2024-09-12T02:09:33.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.714+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ecc101200 con 0x7f1ecc102570 2024-09-12T02:09:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.715+0000 7f1ec8ff9640 1 -- 172.21.15.100:0/1661358311 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1ebc0109d0 con 0x7f1ecc102570 2024-09-12T02:09:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.716+0000 7f1ec8ff9640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1eb40a2c00 0x7f1eb40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.716+0000 7f1ecb7fe640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1eb40a2c00 0x7f1eb40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.716+0000 7f1ec8ff9640 1 -- 172.21.15.100:0/1661358311 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1ebc0cec30 con 0x7f1ecc102570 2024-09-12T02:09:33.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.716+0000 7f1ecb7fe640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1eb40a2c00 0x7f1eb40a50c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00058c0 tx=0x7f1ec0005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:33.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.720+0000 7f1ec8ff9640 1 -- 172.21.15.100:0/1661358311 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ebc009de0 con 0x7f1ecc102570 2024-09-12T02:09:33.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.922+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ecc10a0a0 con 0x7f1ecc102570 2024-09-12T02:09:33.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.922+0000 7f1ec8ff9640 1 -- 172.21.15.100:0/1661358311 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11931 (secure 0 0 0) 0x7f1ebc09bba0 con 0x7f1ecc102570 2024-09-12T02:09:33.923 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:09:33.923 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-12T02:08:26:210418+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/984711890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":984711890},{"type":"v1","addr":"172.21.15.100:6835","nonce":984711890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/650735571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":650735571},{"type":"v1","addr":"172.21.15.100:6837","nonce":650735571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3243845929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3243845929},{"type":"v1","addr":"172.21.15.100:6839","nonce":3243845929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6841/1518201039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6840","nonce":1518201039},{"type":"v1","addr":"172.21.15.100:6841","nonce":1518201039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24380,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/1856036067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":1856036067},{"type":"v1","addr":"172.21.15.117:6833","nonce":1856036067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2089566661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2089566661},{"type":"v1","addr":"172.21.15.189:6833","nonce":2089566661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:05:07.550581+0000","modified":"2024-09-12T02:08:25.469043+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24452,"mds_1":24433,"mds_2":24428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3915021752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3915021752},{"type":"v1","addr":"172.21.15.117:6835","nonce":3915021752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/2566860695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":2566860695},{"type":"v1","addr":"172.21.15.189:6835","nonce":2566860695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3569067822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3569067822},{"type":"v1","addr":"172.21.15.189:6837","nonce":3569067822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.117:6837/137176693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":137176693},{"type":"v1","addr":"172.21.15.117:6837","nonce":137176693}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/2548139728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2548139728},{"type":"v1","addr":"172.21.15.189:6839","nonce":2548139728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6839/3211661343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":3211661343},{"type":"v1","addr":"172.21.15.117:6839","nonce":3211661343}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24428,24433,24452]},"id":1}]} 2024-09-12T02:09:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-12T02:09:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1eb40a2c00 msgr2=0x7f1eb40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1eb40a2c00 0x7f1eb40a50c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00058c0 tx=0x7f1ec0005d30 comp rx=0 tx=0).stop 2024-09-12T02:09:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102570 msgr2=0x7f1ecc198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102570 0x7f1ecc198a40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00d950 tx=0x7f1ebc00de10 comp rx=0 tx=0).stop 2024-09-12T02:09:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 shutdown_connections 2024-09-12T02:09:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f1eb40a2c00 0x7f1eb40a50c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ecc102ef0 0x7f1ecc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ecc102570 0x7f1ecc198a40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 --2- 172.21.15.100:0/1661358311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc100e20 0x7f1ecc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 >> 172.21.15.100:0/1661358311 conn(0x7f1ecc0fc7d0 msgr2=0x7f1ecc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 shutdown_connections 2024-09-12T02:09:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:33.925+0000 7f1ed1f25640 1 -- 172.21.15.100:0/1661358311 wait complete. 2024-09-12T02:09:34.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:34 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/1661358311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:34.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:34 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/1661358311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:34.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:09:34.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:34 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/1661358311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:35.283 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:35 smithi100 ceph-mon[31179]: pgmap v408: 97 pgs: 97 active+clean; 9.5 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-12T02:09:35.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 -- 172.21.15.100:0/640428988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 msgr2=0x7f2320100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:35.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 --2- 172.21.15.100:0/640428988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320100570 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2310009930 tx=0x7f231002a420 comp rx=0 tx=0).stop 2024-09-12T02:09:35.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 -- 172.21.15.100:0/640428988 shutdown_connections 2024-09-12T02:09:35.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 --2- 172.21.15.100:0/640428988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2320106ea0 0x7f232010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 --2- 172.21.15.100:0/640428988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2320100b40 0x7f2320106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 --2- 172.21.15.100:0/640428988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320100570 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 -- 172.21.15.100:0/640428988 >> 172.21.15.100:0/640428988 conn(0x7f2320077010 msgr2=0x7f23200fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 -- 172.21.15.100:0/640428988 shutdown_connections 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.361+0000 7f23251a0640 1 -- 172.21.15.100:0/640428988 wait complete. 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 Processor -- start 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 -- start start 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320101110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2320100b40 0x7f2320101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2320106ea0 0x7f2320101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2320111ef0 con 0x7f2320100190 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2320111d70 con 0x7f2320106ea0 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f23251a0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2320112070 con 0x7f2320100b40 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320101110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320101110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52440/0 (socket says 172.21.15.100:52440) 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 -- 172.21.15.100:0/2215333583 learned_addr learned my addr 172.21.15.100:0/2215333583 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f2317fff640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2320100b40 0x7f2320101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f232499f640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2320106ea0 0x7f2320101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:35.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 -- 172.21.15.100:0/2215333583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2320100b40 msgr2=0x7f2320101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:35.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2320100b40 0x7f2320101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 -- 172.21.15.100:0/2215333583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2320106ea0 msgr2=0x7f2320101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:35.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2320106ea0 0x7f2320101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f231ffff640 1 -- 172.21.15.100:0/2215333583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23201a6950 con 0x7f2320100190 2024-09-12T02:09:35.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.362+0000 7f232499f640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2320106ea0 0x7f2320101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:35.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.363+0000 7f231ffff640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320101110 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2310009230 tx=0x7f2310004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.363+0000 7f231dffb640 1 -- 172.21.15.100:0/2215333583 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231003f030 con 0x7f2320100190 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.363+0000 7f231dffb640 1 -- 172.21.15.100:0/2215333583 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2310003ad0 con 0x7f2320100190 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.363+0000 7f231dffb640 1 -- 172.21.15.100:0/2215333583 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310035070 con 0x7f2320100190 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.363+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23201a6be0 con 0x7f2320100190 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.363+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23201a7070 con 0x7f2320100190 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.364+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2320100570 con 0x7f2320100190 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.365+0000 7f231dffb640 1 -- 172.21.15.100:0/2215333583 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2310042030 con 0x7f2320100190 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.366+0000 7f231dffb640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f230c0a2cd0 0x7f230c0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.366+0000 7f231dffb640 1 -- 172.21.15.100:0/2215333583 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f23100ef5d0 con 0x7f2320100190 2024-09-12T02:09:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.366+0000 7f2317fff640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f230c0a2cd0 0x7f230c0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.367+0000 7f2317fff640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f230c0a2cd0 0x7f230c0a5190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2320102ba0 tx=0x7f230800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.369+0000 7f231dffb640 1 -- 172.21.15.100:0/2215333583 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23100bc5c0 con 0x7f2320100190 2024-09-12T02:09:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.537+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2320103250 con 0x7f2320100190 2024-09-12T02:09:35.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.539+0000 7f231dffb640 1 -- 172.21.15.100:0/2215333583 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22795 (secure 0 0 0) 0x7f23100bbec0 con 0x7f2320100190 2024-09-12T02:09:35.539 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T02:09:35.540 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":82,"fsid":"3a2902f2-70aa-11ef-bcea-c7b262605968","created":"2024-09-12T01:57:36.930004+0000","modified":"2024-09-12T02:05:23.109874+0000","last_up_change":"2024-09-12T02:04:18.112116+0000","last_in_change":"2024-09-12T02:03:54.560723+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:00:34.232777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:05:03.311397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:05:05.761455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b493f8bd-74b9-487f-a058-e4bb350868c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6803","nonce":590713730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6805","nonce":590713730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6809","nonce":590713730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":590713730},{"type":"v1","addr":"172.21.15.100:6807","nonce":590713730}]},"public_addr":"172.21.15.100:6803/590713730","cluster_addr":"172.21.15.100:6805/590713730","heartbeat_back_addr":"172.21.15.100:6809/590713730","heartbeat_front_addr":"172.21.15.100:6807/590713730","state":["exists","up"]},{"osd":1,"uuid":"9d934f40-d17c-4cc0-bf73-2e7afa558fee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6801","nonce":2755635305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6803","nonce":2755635305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6807","nonce":2755635305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2755635305},{"type":"v1","addr":"172.21.15.117:6805","nonce":2755635305}]},"public_addr":"172.21.15.117:6801/2755635305","cluster_addr":"172.21.15.117:6803/2755635305","heartbeat_back_addr":"172.21.15.117:6807/2755635305","heartbeat_front_addr":"172.21.15.117:6805/2755635305","state":["exists","up"]},{"osd":2,"uuid":"d8dc133a-5014-4f6a-8f17-33a94f1f84f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6801","nonce":1587987599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6803","nonce":1587987599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6807","nonce":1587987599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1587987599},{"type":"v1","addr":"172.21.15.189:6805","nonce":1587987599}]},"public_addr":"172.21.15.189:6801/1587987599","cluster_addr":"172.21.15.189:6803/1587987599","heartbeat_back_addr":"172.21.15.189:6807/1587987599","heartbeat_front_addr":"172.21.15.189:6805/1587987599","state":["exists","up"]},{"osd":3,"uuid":"d4d57e9c-f48a-4a2d-a8ce-03a263a479a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6811","nonce":2982818857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6813","nonce":2982818857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6817","nonce":2982818857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2982818857},{"type":"v1","addr":"172.21.15.100:6815","nonce":2982818857}]},"public_addr":"172.21.15.100:6811/2982818857","cluster_addr":"172.21.15.100:6813/2982818857","heartbeat_back_addr":"172.21.15.100:6817/2982818857","heartbeat_front_addr":"172.21.15.100:6815/2982818857","state":["exists","up"]},{"osd":4,"uuid":"f6ac3570-1a74-41a5-8499-f05ebb8dda78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6809","nonce":855252072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6811","nonce":855252072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6815","nonce":855252072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":855252072},{"type":"v1","addr":"172.21.15.117:6813","nonce":855252072}]},"public_addr":"172.21.15.117:6809/855252072","cluster_addr":"172.21.15.117:6811/855252072","heartbeat_back_addr":"172.21.15.117:6815/855252072","heartbeat_front_addr":"172.21.15.117:6813/855252072","state":["exists","up"]},{"osd":5,"uuid":"f3a5c2d4-bcf3-4436-8bec-636f3afb33bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6809","nonce":3192404099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6811","nonce":3192404099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6815","nonce":3192404099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3192404099},{"type":"v1","addr":"172.21.15.189:6813","nonce":3192404099}]},"public_addr":"172.21.15.189:6809/3192404099","cluster_addr":"172.21.15.189:6811/3192404099","heartbeat_back_addr":"172.21.15.189:6815/3192404099","heartbeat_front_addr":"172.21.15.189:6813/3192404099","state":["exists","up"]},{"osd":6,"uuid":"ff037492-9e8b-4d22-9ba3-6037e1a6768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6819","nonce":4036405723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6821","nonce":4036405723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6825","nonce":4036405723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4036405723},{"type":"v1","addr":"172.21.15.100:6823","nonce":4036405723}]},"public_addr":"172.21.15.100:6819/4036405723","cluster_addr":"172.21.15.100:6821/4036405723","heartbeat_back_addr":"172.21.15.100:6825/4036405723","heartbeat_front_addr":"172.21.15.100:6823/4036405723","state":["exists","up"]},{"osd":7,"uuid":"011b6708-d8e1-4507-833e-741dc9a33420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6817","nonce":3443138169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6819","nonce":3443138169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6823","nonce":3443138169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3443138169},{"type":"v1","addr":"172.21.15.117:6821","nonce":3443138169}]},"public_addr":"172.21.15.117:6817/3443138169","cluster_addr":"172.21.15.117:6819/3443138169","heartbeat_back_addr":"172.21.15.117:6823/3443138169","heartbeat_front_addr":"172.21.15.117:6821/3443138169","state":["exists","up"]},{"osd":8,"uuid":"0a00ffca-95d7-433d-bc1a-68396546d03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6817","nonce":1310528835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6819","nonce":1310528835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6823","nonce":1310528835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1310528835},{"type":"v1","addr":"172.21.15.189:6821","nonce":1310528835}]},"public_addr":"172.21.15.189:6817/1310528835","cluster_addr":"172.21.15.189:6819/1310528835","heartbeat_back_addr":"172.21.15.189:6823/1310528835","heartbeat_front_addr":"172.21.15.189:6821/1310528835","state":["exists","up"]},{"osd":9,"uuid":"87dd5e07-6deb-4214-954a-97a4336421be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6827","nonce":2410385779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6829","nonce":2410385779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6833","nonce":2410385779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2410385779},{"type":"v1","addr":"172.21.15.100:6831","nonce":2410385779}]},"public_addr":"172.21.15.100:6827/2410385779","cluster_addr":"172.21.15.100:6829/2410385779","heartbeat_back_addr":"172.21.15.100:6833/2410385779","heartbeat_front_addr":"172.21.15.100:6831/2410385779","state":["exists","up"]},{"osd":10,"uuid":"bdae8a8c-9fff-4a3f-8cbe-e57f8624b0a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6825","nonce":1542358432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6827","nonce":1542358432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6831","nonce":1542358432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1542358432},{"type":"v1","addr":"172.21.15.117:6829","nonce":1542358432}]},"public_addr":"172.21.15.117:6825/1542358432","cluster_addr":"172.21.15.117:6827/1542358432","heartbeat_back_addr":"172.21.15.117:6831/1542358432","heartbeat_front_addr":"172.21.15.117:6829/1542358432","state":["exists","up"]},{"osd":11,"uuid":"37a8335a-5b03-425b-b336-49fb04b357ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6825","nonce":3473203367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6827","nonce":3473203367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6831","nonce":3473203367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3473203367},{"type":"v1","addr":"172.21.15.189:6829","nonce":3473203367}]},"public_addr":"172.21.15.189:6825/3473203367","cluster_addr":"172.21.15.189:6827/3473203367","heartbeat_back_addr":"172.21.15.189:6831/3473203367","heartbeat_front_addr":"172.21.15.189:6829/3473203367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:59:43.065022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:08.125077+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:32.673522+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:00:58.253053+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:23.396964+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:01:47.724058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:12.856880+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:02:36.768295+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:01.886670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:27.444198+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:03:51.591054+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:04:16.515612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/3840981165":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/2411453195":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6800/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:6800/824408405":"2024-09-13T01:58:21.937252+0000","172.21.15.100:6801/2932456441":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1570268784":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/1018467611":"2024-09-13T01:57:58.286368+0000","172.21.15.100:0/3007182945":"2024-09-13T01:58:21.937252+0000","172.21.15.100:0/4194493962":"2024-09-13T01:57:58.286368+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:09:35.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f230c0a2cd0 msgr2=0x7f230c0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:35.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f230c0a2cd0 0x7f230c0a5190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2320102ba0 tx=0x7f230800b390 comp rx=0 tx=0).stop 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 msgr2=0x7f2320101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320101110 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2310009230 tx=0x7f2310004270 comp rx=0 tx=0).stop 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 shutdown_connections 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f230c0a2cd0 0x7f230c0a5190 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2320106ea0 0x7f2320101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2320100b40 0x7f2320101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 --2- 172.21.15.100:0/2215333583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2320100190 0x7f2320101110 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 >> 172.21.15.100:0/2215333583 conn(0x7f2320077010 msgr2=0x7f23200fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 shutdown_connections 2024-09-12T02:09:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:35.541+0000 7f23251a0640 1 -- 172.21.15.100:0/2215333583 wait complete. 2024-09-12T02:09:35.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:35 smithi189 ceph-mon[35188]: pgmap v408: 97 pgs: 97 active+clean; 9.5 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-12T02:09:35.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:35 smithi117 ceph-mon[35240]: pgmap v408: 97 pgs: 97 active+clean; 9.5 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-12T02:09:36.207 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T02:09:36.454 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:36.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:36 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2215333583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:36.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:36 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2215333583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:36.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:36 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2215333583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 -- 172.21.15.100:0/3487029068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8100a80 msgr2=0x7f8db8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/3487029068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8100a80 0x7f8db8100ee0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009930 tx=0x7f8da002a420 comp rx=0 tx=0).stop 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 -- 172.21.15.100:0/3487029068 shutdown_connections 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/3487029068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8db8101420 0x7f8db810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/3487029068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8100a80 0x7f8db8100ee0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/3487029068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db8106a80 0x7f8db8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 -- 172.21.15.100:0/3487029068 >> 172.21.15.100:0/3487029068 conn(0x7f8db80fc7a0 msgr2=0x7f8db80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 -- 172.21.15.100:0/3487029068 shutdown_connections 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.900+0000 7f8dbdce0640 1 -- 172.21.15.100:0/3487029068 wait complete. 2024-09-12T02:09:36.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 Processor -- start 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 -- start start 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8db8100a80 0x7f8db8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db8101420 0x7f8db8199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8106a80 0x7f8db81a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8110f20 con 0x7f8db8106a80 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8110da0 con 0x7f8db8101420 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8dbdce0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81110a0 con 0x7f8db8100a80 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8106a80 0x7f8db81a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8106a80 0x7f8db81a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52464/0 (socket says 172.21.15.100:52464) 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 -- 172.21.15.100:0/2352582501 learned_addr learned my addr 172.21.15.100:0/2352582501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db77fe640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8db8100a80 0x7f8db8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8daffff640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db8101420 0x7f8db8199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:36.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 -- 172.21.15.100:0/2352582501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8db8100a80 msgr2=0x7f8db8199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8db8100a80 0x7f8db8199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 -- 172.21.15.100:0/2352582501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db8101420 msgr2=0x7f8db8199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db8101420 0x7f8db8199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 -- 172.21.15.100:0/2352582501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db8197240 con 0x7f8db8106a80 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8daffff640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db8101420 0x7f8db8199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.901+0000 7f8db7fff640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8106a80 0x7f8db81a44d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8db000b970 tx=0x7f8db000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.902+0000 7f8db57fa640 1 -- 172.21.15.100:0/2352582501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0019070 con 0x7f8db8106a80 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.902+0000 7f8db57fa640 1 -- 172.21.15.100:0/2352582501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db000cb40 con 0x7f8db8106a80 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.902+0000 7f8db57fa640 1 -- 172.21.15.100:0/2352582501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0007650 con 0x7f8db8106a80 2024-09-12T02:09:36.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.902+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db8197530 con 0x7f8db8106a80 2024-09-12T02:09:36.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.902+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db8197a70 con 0x7f8db8106a80 2024-09-12T02:09:36.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.903+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db81021c0 con 0x7f8db8106a80 2024-09-12T02:09:36.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.904+0000 7f8db57fa640 1 -- 172.21.15.100:0/2352582501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f8db001c070 con 0x7f8db8106a80 2024-09-12T02:09:36.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.904+0000 7f8db57fa640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8da40a2c00 0x7f8da40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:36.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.905+0000 7f8db77fe640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8da40a2c00 0x7f8da40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:36.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.905+0000 7f8db57fa640 1 -- 172.21.15.100:0/2352582501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8db00cead0 con 0x7f8db8106a80 2024-09-12T02:09:36.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.905+0000 7f8db77fe640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8da40a2c00 0x7f8da40a50c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009890 tx=0x7f8da8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:36.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:36.908+0000 7f8db57fa640 1 -- 172.21.15.100:0/2352582501 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8db009ba40 con 0x7f8db8106a80 2024-09-12T02:09:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.108+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8db802d7c0 con 0x7f8db8106a80 2024-09-12T02:09:37.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.111+0000 7f8db57fa640 1 -- 172.21.15.100:0/2352582501 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f8db009b340 con 0x7f8db8106a80 2024-09-12T02:09:37.111 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:09:37.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8da40a2c00 msgr2=0x7f8da40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:37.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8da40a2c00 0x7f8da40a50c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009890 tx=0x7f8da8008040 comp rx=0 tx=0).stop 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8106a80 msgr2=0x7f8db81a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8106a80 0x7f8db81a44d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8db000b970 tx=0x7f8db000be30 comp rx=0 tx=0).stop 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 shutdown_connections 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f8da40a2c00 0x7f8da40a50c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8db8106a80 0x7f8db81a44d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db8101420 0x7f8db8199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 --2- 172.21.15.100:0/2352582501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8db8100a80 0x7f8db8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 >> 172.21.15.100:0/2352582501 conn(0x7f8db80fc7a0 msgr2=0x7f8db80fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.113+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 shutdown_connections 2024-09-12T02:09:37.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:37.114+0000 7f8dbdce0640 1 -- 172.21.15.100:0/2352582501 wait complete. 2024-09-12T02:09:37.175 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a[31175]: 2024-09-12T02:09:37.109+0000 7fdb1b04e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: pgmap v409: 97 pgs: 97 active+clean; 9.5 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2352582501' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2352582501' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:09:37.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:37 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: pgmap v409: 97 pgs: 97 active+clean; 9.5 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T02:09:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2352582501' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:09:37.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2352582501' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c[66165]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c[66165]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mds[66169]: -- 172.21.15.189:0/139349017 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cf13f05c20 con 0x55cf13ee2800 2024-09-12T02:09:37.594 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c[66165]: starting mds.c at 2024-09-12T02:09:37.595 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f[65865]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:37.595 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f[65865]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:37.595 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mds[65869]: -- 172.21.15.189:0/114705692 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b7a0a1f860 con 0x55b7a09fc800 2024-09-12T02:09:37.595 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f[65865]: starting mds.f at 2024-09-12T02:09:37.595 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i[66466]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:37.595 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i[66466]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:37.595 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-mds[66470]: -- 172.21.15.189:0/3226208180 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c6a109860 con 0x558c6a0e7000 2024-09-12T02:09:37.596 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:09:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i[66466]: starting mds.i at 2024-09-12T02:09:37.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e[65429]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:37.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e[65429]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:37.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mds[65433]: -- 172.21.15.117:0/2681539434 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558ed8a9f860 con 0x558ed8a7c800 2024-09-12T02:09:37.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e[65429]: starting mds.e at 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: pgmap v409: 97 pgs: 97 active+clean; 9.5 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2352582501' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2352582501' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:37.651 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:37.652 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mds[66033]: -- 172.21.15.117:0/620088696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b04d780680 con 0x55b04d754800 2024-09-12T02:09:37.652 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mds[66033]: -- 172.21.15.117:0/620088696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b04d777860 con 0x55b04d754800 2024-09-12T02:09:37.652 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: starting mds.b at 2024-09-12T02:09:37.652 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h[65728]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:37.652 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h[65728]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:37.652 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-mds[65732]: -- 172.21.15.117:0/361964073 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a295ddd860 con 0x55a295dbb000 2024-09-12T02:09:37.652 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:09:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h[65728]: starting mds.h at 2024-09-12T02:09:37.806 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:09:38.055 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:38.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 -- 172.21.15.100:0/1160155356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 msgr2=0x7f164c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:38.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 --2- 172.21.15.100:0/1160155356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c10da40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1644009ca0 tx=0x7f164402a950 comp rx=0 tx=0).stop 2024-09-12T02:09:38.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 -- 172.21.15.100:0/1160155356 shutdown_connections 2024-09-12T02:09:38.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 --2- 172.21.15.100:0/1160155356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c10da40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 --2- 172.21.15.100:0/1160155356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f164c102570 0x7f164c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 --2- 172.21.15.100:0/1160155356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c100e20 0x7f164c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 -- 172.21.15.100:0/1160155356 >> 172.21.15.100:0/1160155356 conn(0x7f164c0fc7d0 msgr2=0x7f164c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 -- 172.21.15.100:0/1160155356 shutdown_connections 2024-09-12T02:09:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.536+0000 7f1651f6b640 1 -- 172.21.15.100:0/1160155356 wait complete. 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 Processor -- start 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 -- start start 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f164c100e20 0x7f164c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f164c110f80 con 0x7f164c102ef0 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f164c110e00 con 0x7f164c100e20 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f1651f6b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f164c111100 con 0x7f164c102570 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f164bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f164bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52476/0 (socket says 172.21.15.100:52476) 2024-09-12T02:09:38.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.537+0000 7f164bfff640 1 -- 172.21.15.100:0/70956176 learned_addr learned my addr 172.21.15.100:0/70956176 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164affd640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164b7fe640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f164c100e20 0x7f164c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164bfff640 1 -- 172.21.15.100:0/70956176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 msgr2=0x7f164c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164bfff640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164bfff640 1 -- 172.21.15.100:0/70956176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f164c100e20 msgr2=0x7f164c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164bfff640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f164c100e20 0x7f164c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164bfff640 1 -- 172.21.15.100:0/70956176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c1a4870 con 0x7f164c102ef0 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164affd640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164b7fe640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f164c100e20 0x7f164c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f164bfff640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c1a4330 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1644004af0 tx=0x7f164402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f1648ff9640 1 -- 172.21.15.100:0/70956176 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644034040 con 0x7f164c102ef0 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f1648ff9640 1 -- 172.21.15.100:0/70956176 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1644030920 con 0x7f164c102ef0 2024-09-12T02:09:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c1a4a40 con 0x7f164c102ef0 2024-09-12T02:09:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f1648ff9640 1 -- 172.21.15.100:0/70956176 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644004820 con 0x7f164c102ef0 2024-09-12T02:09:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.538+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c1a4e90 con 0x7f164c102ef0 2024-09-12T02:09:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.539+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c101200 con 0x7f164c102ef0 2024-09-12T02:09:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.540+0000 7f1648ff9640 1 -- 172.21.15.100:0/70956176 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1644037020 con 0x7f164c102ef0 2024-09-12T02:09:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.541+0000 7f1648ff9640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16340a2b80 0x7f16340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.541+0000 7f164b7fe640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16340a2b80 0x7f16340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.541+0000 7f1648ff9640 1 -- 172.21.15.100:0/70956176 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f16440f00c0 con 0x7f164c102ef0 2024-09-12T02:09:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.541+0000 7f164b7fe640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16340a2b80 0x7f16340a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f163c005fd0 tx=0x7f163c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:38.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.545+0000 7f1648ff9640 1 -- 172.21.15.100:0/70956176 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16440bced0 con 0x7f164c102ef0 2024-09-12T02:09:38.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:38.746+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f164c1a50c0 con 0x7f164c102ef0 2024-09-12T02:09:39.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.177+0000 7f1648ff9640 1 -- 172.21.15.100:0/70956176 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f16440bc7d0 con 0x7f164c102ef0 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16340a2b80 msgr2=0x7f16340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16340a2b80 0x7f16340a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f163c005fd0 tx=0x7f163c00b5f0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 msgr2=0x7f164c1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c1a4330 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1644004af0 tx=0x7f164402f5b0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 shutdown_connections 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f16340a2b80 0x7f16340a5040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f164c102ef0 0x7f164c1a4330 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f164c102570 0x7f164c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 --2- 172.21.15.100:0/70956176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f164c100e20 0x7f164c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 >> 172.21.15.100:0/70956176 conn(0x7f164c0fc7d0 msgr2=0x7f164c106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 shutdown_connections 2024-09-12T02:09:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:39.181+0000 7f1651f6b640 1 -- 172.21.15.100:0/70956176 wait complete. 2024-09-12T02:09:39.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: pgmap v411: 97 pgs: 97 active+clean; 9.5 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 819 B/s wr, 7 op/s 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6834/202826147,v1:172.21.15.189:6835/202826147] up:boot 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6834/966805337,v1:172.21.15.117:6835/966805337] up:boot 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6836/2903620163,v1:172.21.15.117:6837/2903620163] up:boot 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.117:6838/481390497,v1:172.21.15.117:6839/481390497] up:boot 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6836/2159280233,v1:172.21.15.189:6838/2159280233] up:boot 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: mds.? [v2:172.21.15.189:6837/808818625,v1:172.21.15.189:6839/808818625] up:boot 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:09:39.401 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:09:39.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:09:39.402 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:39 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/70956176' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:39.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: pgmap v411: 97 pgs: 97 active+clean; 9.5 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 819 B/s wr, 7 op/s 2024-09-12T02:09:39.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6834/202826147,v1:172.21.15.189:6835/202826147] up:boot 2024-09-12T02:09:39.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6834/966805337,v1:172.21.15.117:6835/966805337] up:boot 2024-09-12T02:09:39.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6836/2903620163,v1:172.21.15.117:6837/2903620163] up:boot 2024-09-12T02:09:39.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.117:6838/481390497,v1:172.21.15.117:6839/481390497] up:boot 2024-09-12T02:09:39.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6836/2159280233,v1:172.21.15.189:6838/2159280233] up:boot 2024-09-12T02:09:39.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: mds.? [v2:172.21.15.189:6837/808818625,v1:172.21.15.189:6839/808818625] up:boot 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:09:39.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:39 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/70956176' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: pgmap v411: 97 pgs: 97 active+clean; 9.5 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 819 B/s wr, 7 op/s 2024-09-12T02:09:39.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6834/202826147,v1:172.21.15.189:6835/202826147] up:boot 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6834/966805337,v1:172.21.15.117:6835/966805337] up:boot 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6836/2903620163,v1:172.21.15.117:6837/2903620163] up:boot 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.117:6838/481390497,v1:172.21.15.117:6839/481390497] up:boot 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6836/2159280233,v1:172.21.15.189:6838/2159280233] up:boot 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: mds.? [v2:172.21.15.189:6837/808818625,v1:172.21.15.189:6839/808818625] up:boot 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: from='mgr.14150 172.21.15.100:0/77124682' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:09:39.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:39 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/70956176' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:39.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:09:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:40.265 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:40 smithi100 ceph-mon[31179]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:09:40.265 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:40 smithi100 ceph-mon[31179]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:09:40.266 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:40 smithi100 ceph-mon[31179]: Cluster is now healthy 2024-09-12T02:09:40.266 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:40 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/70956176' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:09:40.266 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:40 smithi100 ceph-mon[31179]: fsmap 12 up:standby 2024-09-12T02:09:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:40 smithi117 ceph-mon[35240]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:09:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:40 smithi117 ceph-mon[35240]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:09:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:40 smithi117 ceph-mon[35240]: Cluster is now healthy 2024-09-12T02:09:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:40 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/70956176' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:09:40.400 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:40 smithi117 ceph-mon[35240]: fsmap 12 up:standby 2024-09-12T02:09:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:40 smithi189 ceph-mon[35188]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:09:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:40 smithi189 ceph-mon[35188]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:09:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:40 smithi189 ceph-mon[35188]: Cluster is now healthy 2024-09-12T02:09:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:40 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/70956176' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:09:40.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:40 smithi189 ceph-mon[35188]: fsmap 12 up:standby 2024-09-12T02:09:40.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 -- 172.21.15.100:0/2602140289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab01068d0 msgr2=0x7f6ab0106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2602140289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab01068d0 0x7f6ab0106cb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009900 tx=0x7f6aa402a410 comp rx=0 tx=0).stop 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 -- 172.21.15.100:0/2602140289 shutdown_connections 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2602140289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab0101270 0x7f6ab010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2602140289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ab01008d0 0x7f6ab0100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2602140289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab01068d0 0x7f6ab0106cb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 -- 172.21.15.100:0/2602140289 >> 172.21.15.100:0/2602140289 conn(0x7f6ab00fc610 msgr2=0x7f6ab00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 -- 172.21.15.100:0/2602140289 shutdown_connections 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.613+0000 7f6ab4802640 1 -- 172.21.15.100:0/2602140289 wait complete. 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 Processor -- start 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 -- start start 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab01008d0 0x7f6ab01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:40.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab0101270 0x7f6ab0198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ab01068d0 0x7f6ab019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab0111df0 con 0x7f6ab0101270 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab0111c70 con 0x7f6ab01008d0 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6ab4802640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab0111f70 con 0x7f6ab01068d0 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aae59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab0101270 0x7f6ab0198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aae59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab0101270 0x7f6ab0198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52494/0 (socket says 172.21.15.100:52494) 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aae59c640 1 -- 172.21.15.100:0/2431900771 learned_addr learned my addr 172.21.15.100:0/2431900771 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aaed9d640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab01008d0 0x7f6ab01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aaf59e640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ab01068d0 0x7f6ab019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aae59c640 1 -- 172.21.15.100:0/2431900771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ab01068d0 msgr2=0x7f6ab019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aae59c640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ab01068d0 0x7f6ab019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aae59c640 1 -- 172.21.15.100:0/2431900771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab01008d0 msgr2=0x7f6ab01982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.614+0000 7f6aae59c640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab01008d0 0x7f6ab01982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6aae59c640 1 -- 172.21.15.100:0/2431900771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab019d2a0 con 0x7f6ab0101270 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6aaed9d640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab01008d0 0x7f6ab01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6aae59c640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab0101270 0x7f6ab0198830 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000b4a0 tx=0x7f6aa000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6a97fff640 1 -- 172.21.15.100:0/2431900771 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0014070 con 0x7f6ab0101270 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab019d590 con 0x7f6ab0101270 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6a97fff640 1 -- 172.21.15.100:0/2431900771 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa0010af0 con 0x7f6ab0101270 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6a97fff640 1 -- 172.21.15.100:0/2431900771 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0017d10 con 0x7f6ab0101270 2024-09-12T02:09:40.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.615+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab01a4e70 con 0x7f6ab0101270 2024-09-12T02:09:40.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.616+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab0100d30 con 0x7f6ab0101270 2024-09-12T02:09:40.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.617+0000 7f6a97fff640 1 -- 172.21.15.100:0/2431900771 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6aa0017070 con 0x7f6ab0101270 2024-09-12T02:09:40.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.618+0000 7f6a97fff640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a980a2b80 0x7f6a980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:40.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.618+0000 7f6aaed9d640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a980a2b80 0x7f6a980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:40.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.618+0000 7f6a97fff640 1 -- 172.21.15.100:0/2431900771 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6aa00ce620 con 0x7f6ab0101270 2024-09-12T02:09:40.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.618+0000 7f6aaed9d640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a980a2b80 0x7f6a980a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4005ab0 tx=0x7f6aa4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:40.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.622+0000 7f6a97fff640 1 -- 172.21.15.100:0/2431900771 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6aa009b490 con 0x7f6ab0101270 2024-09-12T02:09:40.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:40.794+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6ab002d7c0 con 0x7f6ab0101270 2024-09-12T02:09:41.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.185+0000 7f6a97fff640 1 -- 172.21.15.100:0/2431900771 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f6aa009ad90 con 0x7f6ab0101270 2024-09-12T02:09:41.185 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:09:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a980a2b80 msgr2=0x7f6a980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a980a2b80 0x7f6a980a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4005ab0 tx=0x7f6aa4005a20 comp rx=0 tx=0).stop 2024-09-12T02:09:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab0101270 msgr2=0x7f6ab0198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab0101270 0x7f6ab0198830 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000b4a0 tx=0x7f6aa000b960 comp rx=0 tx=0).stop 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 shutdown_connections 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7f6a980a2b80 0x7f6a980a5040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ab01068d0 0x7f6ab019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab0101270 0x7f6ab0198830 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 --2- 172.21.15.100:0/2431900771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab01008d0 0x7f6ab01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.188+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 >> 172.21.15.100:0/2431900771 conn(0x7f6ab00fc610 msgr2=0x7f6ab00fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.189+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 shutdown_connections 2024-09-12T02:09:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:41.189+0000 7f6ab4802640 1 -- 172.21.15.100:0/2431900771 wait complete. 2024-09-12T02:09:41.557 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:41 smithi100 ceph-mon[31179]: pgmap v412: 97 pgs: 97 active+clean; 9.5 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 819 B/s wr, 6 op/s 2024-09-12T02:09:41.557 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:41 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2431900771' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:41 smithi189 ceph-mon[35188]: pgmap v412: 97 pgs: 97 active+clean; 9.5 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 819 B/s wr, 6 op/s 2024-09-12T02:09:41.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:41 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2431900771' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:41 smithi117 ceph-mon[35240]: pgmap v412: 97 pgs: 97 active+clean; 9.5 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 819 B/s wr, 6 op/s 2024-09-12T02:09:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:41 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2431900771' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:41.939 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:09:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:42.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:42 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/2431900771' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:42.439 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:42 smithi100 ceph-mon[31179]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:09:42.449 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:42 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/2431900771' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:42.449 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:42 smithi189 ceph-mon[35188]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:09:42.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 -- 172.21.15.100:0/1545375696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084101de0 msgr2=0x7fb0841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:42.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 --2- 172.21.15.100:0/1545375696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084101de0 0x7fb0841021c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb080009900 tx=0x7fb08002a410 comp rx=0 tx=0).stop 2024-09-12T02:09:42.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 -- 172.21.15.100:0/1545375696 shutdown_connections 2024-09-12T02:09:42.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 --2- 172.21.15.100:0/1545375696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb084106f10 0x7fb08410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 --2- 172.21.15.100:0/1545375696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb084102790 0x7fb0841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 --2- 172.21.15.100:0/1545375696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084101de0 0x7fb0841021c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 -- 172.21.15.100:0/1545375696 >> 172.21.15.100:0/1545375696 conn(0x7fb0840fd8c0 msgr2=0x7fb0840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 -- 172.21.15.100:0/1545375696 shutdown_connections 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.644+0000 7fb08b818640 1 -- 172.21.15.100:0/1545375696 wait complete. 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 Processor -- start 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 -- start start 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb084101de0 0x7fb0841985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb084102790 0x7fb084198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084106f10 0x7fb08419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112010 con 0x7fb084106f10 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb084111e90 con 0x7fb084101de0 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb08b818640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112190 con 0x7fb084102790 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084106f10 0x7fb08419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:42.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084106f10 0x7fb08419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52498/0 (socket says 172.21.15.100:52498) 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 -- 172.21.15.100:0/236178557 learned_addr learned my addr 172.21.15.100:0/236178557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb0895b4640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb084101de0 0x7fb0841985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb088db3640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb084102790 0x7fb084198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 -- 172.21.15.100:0/236178557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb084102790 msgr2=0x7fb084198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb084102790 0x7fb084198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 -- 172.21.15.100:0/236178557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb084101de0 msgr2=0x7fb0841985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb084101de0 0x7fb0841985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.645+0000 7fb089db5640 1 -- 172.21.15.100:0/236178557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08419d560 con 0x7fb084106f10 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.646+0000 7fb089db5640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084106f10 0x7fb08419ce80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00b970 tx=0x7fb07c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.646+0000 7fb0767fc640 1 -- 172.21.15.100:0/236178557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c019070 con 0x7fb084106f10 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.646+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08419d850 con 0x7fb084106f10 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.646+0000 7fb0767fc640 1 -- 172.21.15.100:0/236178557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb07c00cb40 con 0x7fb084106f10 2024-09-12T02:09:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.646+0000 7fb0767fc640 1 -- 172.21.15.100:0/236178557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c007650 con 0x7fb084106f10 2024-09-12T02:09:42.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.646+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0841a5130 con 0x7fb084106f10 2024-09-12T02:09:42.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.647+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb084102240 con 0x7fb084106f10 2024-09-12T02:09:42.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.648+0000 7fb0767fc640 1 -- 172.21.15.100:0/236178557 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb07c01c070 con 0x7fb084106f10 2024-09-12T02:09:42.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.648+0000 7fb0767fc640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb0700a2b80 0x7fb0700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:42.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.649+0000 7fb0895b4640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb0700a2b80 0x7fb0700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:42.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.649+0000 7fb0767fc640 1 -- 172.21.15.100:0/236178557 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7944+0+0 (secure 0 0 0) 0x7fb07c0ce570 con 0x7fb084106f10 2024-09-12T02:09:42.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.649+0000 7fb0895b4640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb0700a2b80 0x7fb0700a5040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb0800096c0 tx=0x7fb080031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:42.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:42 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/2431900771' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:42.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:42 smithi117 ceph-mon[35240]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:09:42.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.653+0000 7fb0767fc640 1 -- 172.21.15.100:0/236178557 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb07c09b640 con 0x7fb084106f10 2024-09-12T02:09:42.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:42.820+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb08410a150 con 0x7fb084106f10 2024-09-12T02:09:43.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:43 smithi100 ceph-mon[31179]: pgmap v414: 65 pgs: 65 active+clean; 577 KiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:43.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:43 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/236178557' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:43.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:43 smithi189 ceph-mon[35188]: pgmap v414: 65 pgs: 65 active+clean; 577 KiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:43.593 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:43 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/236178557' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:43.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:43 smithi117 ceph-mon[35240]: pgmap v414: 65 pgs: 65 active+clean; 577 KiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:43.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:43 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/236178557' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:43.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.811+0000 7fb0767fc640 1 -- 172.21.15.100:0/236178557 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7fb07c09af40 con 0x7fb084106f10 2024-09-12T02:09:43.811 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-09-12T02:09:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb0700a2b80 msgr2=0x7fb0700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb0700a2b80 0x7fb0700a5040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb0800096c0 tx=0x7fb080031490 comp rx=0 tx=0).stop 2024-09-12T02:09:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084106f10 msgr2=0x7fb08419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084106f10 0x7fb08419ce80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00b970 tx=0x7fb07c00be30 comp rx=0 tx=0).stop 2024-09-12T02:09:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 shutdown_connections 2024-09-12T02:09:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:6800/3532459665,v1:172.21.15.100:6801/3532459665] conn(0x7fb0700a2b80 0x7fb0700a5040 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb084106f10 0x7fb08419ce80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb084102790 0x7fb084198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 --2- 172.21.15.100:0/236178557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb084101de0 0x7fb0841985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 >> 172.21.15.100:0/236178557 conn(0x7fb0840fd8c0 msgr2=0x7fb0840fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 shutdown_connections 2024-09-12T02:09:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T02:09:43.814+0000 7fb08b818640 1 -- 172.21.15.100:0/236178557 wait complete. 2024-09-12T02:09:44.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:09:44.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:09:44.687 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:09:44.720 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T02:09:44.720 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:09:44.737 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:09:44.755 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:09:44.778 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T02:09:44.778 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T02:09:44.778 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:09:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:44 smithi100 ceph-mon[31179]: from='client.? 172.21.15.100:0/236178557' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:44 smithi100 ceph-mon[31179]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:09:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:44 smithi100 ceph-mon[31179]: pgmap v416: 1 pgs: 1 active+clean; 577 KiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:45.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:44 smithi100 systemd[1]: Stopping Ceph mon.a for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:09:45.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:44 smithi189 ceph-mon[35188]: from='client.? 172.21.15.100:0/236178557' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:45.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:44 smithi189 ceph-mon[35188]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:09:45.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:44 smithi189 ceph-mon[35188]: pgmap v416: 1 pgs: 1 active+clean; 577 KiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:45.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:44 smithi117 ceph-mon[35240]: from='client.? 172.21.15.100:0/236178557' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:45.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:44 smithi117 ceph-mon[35240]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:09:45.150 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:44 smithi117 ceph-mon[35240]: pgmap v416: 1 pgs: 1 active+clean; 577 KiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:45.522 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:45 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a[31175]: 2024-09-12T02:09:45.204+0000 7fdb20859640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:45.523 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:45 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a[31175]: 2024-09-12T02:09:45.204+0000 7fdb20859640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T02:09:45.523 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:45 smithi100 podman[90972]: 2024-09-12 02:09:45.246133588 +0000 UTC m=+0.280118515 container died ba90479fb30c1c8fa5e6f9ba3472ab62b1ef3cb972ff5fe1885a0193013ea555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:09:45.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:45 smithi100 podman[90972]: 2024-09-12 02:09:45.638289779 +0000 UTC m=+0.672274708 container cleanup ba90479fb30c1c8fa5e6f9ba3472ab62b1ef3cb972ff5fe1885a0193013ea555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T02:09:45.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Sep 12 02:09:45 smithi100 bash[90972]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:09:45.987 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T02:09:46.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:46.042 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T02:09:46.042 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T02:09:46.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.b 2024-09-12T02:09:46.376 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:46 smithi117 systemd[1]: Stopping Ceph mon.b for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:09:46.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-b[35236]: 2024-09-12T02:09:46.375+0000 7fc0a1d4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:46.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-b[35236]: 2024-09-12T02:09:46.375+0000 7fc0a1d4b640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:09:46.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:46 smithi117 podman[68727]: 2024-09-12 02:09:46.437781454 +0000 UTC m=+0.160898414 container died 28878a8a46717b643b2dbb6ec07841bc63df2be0077a04ec95f11777a15879bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:09:47.060 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:46 smithi117 podman[68727]: 2024-09-12 02:09:46.892896799 +0000 UTC m=+0.616013794 container cleanup 28878a8a46717b643b2dbb6ec07841bc63df2be0077a04ec95f11777a15879bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:09:47.060 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 12 02:09:46 smithi117 bash[68727]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-b 2024-09-12T02:09:47.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T02:09:47.326 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:47.326 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T02:09:47.326 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T02:09:47.326 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.c 2024-09-12T02:09:47.826 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:47 smithi189 systemd[1]: Stopping Ceph mon.c for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:09:48.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-c[35184]: 2024-09-12T02:09:47.825+0000 7f5191900640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:48.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-c[35184]: 2024-09-12T02:09:47.825+0000 7f5191900640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:09:48.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:48 smithi189 podman[69249]: 2024-09-12 02:09:48.061061432 +0000 UTC m=+0.527392577 container died 403fe64726f31e27c3ebc310eb1005ccdde0314192e54aff253c3a67737b8ffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:09:48.827 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:48 smithi189 podman[69249]: 2024-09-12 02:09:48.55068734 +0000 UTC m=+1.017018486 container cleanup 403fe64726f31e27c3ebc310eb1005ccdde0314192e54aff253c3a67737b8ffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:09:48.827 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 02:09:48 smithi189 bash[69249]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mon-c 2024-09-12T02:09:49.003 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T02:09:49.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:49.050 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T02:09:49.050 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T02:09:49.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:09:49.367 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:09:49 smithi100 systemd[1]: Stopping Ceph mgr.x for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:09:49.717 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:09:49 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x[31409]: 2024-09-12T02:09:49.366+0000 7f9151a46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:49.718 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:09:49 smithi100 podman[91094]: 2024-09-12 02:09:49.398535235 +0000 UTC m=+0.149516707 container died 9d4297736980cd1ec65b6b108cfb27c1e99d686648535d2d016d87dfea6f3014 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:09:50.068 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:09:49 smithi100 podman[91094]: 2024-09-12 02:09:49.884192021 +0000 UTC m=+0.635173492 container cleanup 9d4297736980cd1ec65b6b108cfb27c1e99d686648535d2d016d87dfea6f3014 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:09:50.069 INFO:journalctl@ceph.mgr.x.smithi100.stdout:Sep 12 02:09:49 smithi100 bash[91094]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-x 2024-09-12T02:09:50.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T02:09:50.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:50.291 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T02:09:50.291 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T02:09:50.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.y 2024-09-12T02:09:50.602 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:09:50 smithi117 systemd[1]: Stopping Ceph mgr.y for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:09:50.874 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:09:50 smithi117 podman[68849]: 2024-09-12 02:09:50.603521929 +0000 UTC m=+0.118733429 container died 7b22ae8802525e12b4c45c479a4c86f49b400ffce77d01548b295e648262a6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:09:51.150 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:09:50 smithi117 podman[68849]: 2024-09-12 02:09:50.965608956 +0000 UTC m=+0.480820456 container cleanup 7b22ae8802525e12b4c45c479a4c86f49b400ffce77d01548b295e648262a6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:09:51.150 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 12 02:09:50 smithi117 bash[68849]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-y 2024-09-12T02:09:51.448 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T02:09:51.482 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:51.483 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T02:09:51.483 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T02:09:51.483 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.z 2024-09-12T02:09:51.843 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:09:51 smithi189 systemd[1]: Stopping Ceph mgr.z for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:09:52.179 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:09:51 smithi189 podman[69373]: 2024-09-12 02:09:51.859858832 +0000 UTC m=+0.178022927 container died 49d5bf957f825227388c176f9e9854005647bca42e5a593f4958975acd086047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:09:52.431 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:09:52 smithi189 podman[69373]: 2024-09-12 02:09:52.180306494 +0000 UTC m=+0.498470592 container cleanup 49d5bf957f825227388c176f9e9854005647bca42e5a593f4958975acd086047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:09:52.431 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 02:09:52 smithi189 bash[69373]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mgr-z 2024-09-12T02:09:52.653 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T02:09:52.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:52.688 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T02:09:52.688 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T02:09:52.688 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.0 2024-09-12T02:09:52.989 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:52 smithi100 systemd[1]: Stopping Ceph osd.0 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:09:53.318 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0[45228]: 2024-09-12T02:09:52.987+0000 7f1beb77d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:53.319 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0[45228]: 2024-09-12T02:09:52.987+0000 7f1beb77d640 -1 osd.0 85 *** Got signal Terminated *** 2024-09-12T02:09:53.319 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0[45228]: 2024-09-12T02:09:52.987+0000 7f1beb77d640 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:09:58.798 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:58 smithi100 podman[91214]: 2024-09-12 02:09:58.510767178 +0000 UTC m=+5.628193963 container died 684248ab6c25cc2cb6b9a0d23cf2c57fc22f54847416f6fbdf23ce3953956ad6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T02:09:59.068 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:58 smithi100 podman[91214]: 2024-09-12 02:09:58.972353073 +0000 UTC m=+6.089779849 container cleanup 684248ab6c25cc2cb6b9a0d23cf2c57fc22f54847416f6fbdf23ce3953956ad6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:09:59.069 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:58 smithi100 bash[91214]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0 2024-09-12T02:09:59.587 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:59 smithi100 podman[91229]: 2024-09-12 02:09:59.332518206 +0000 UTC m=+0.820128474 container remove 684248ab6c25cc2cb6b9a0d23cf2c57fc22f54847416f6fbdf23ce3953956ad6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:09:59.842 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:59 smithi100 podman[91323]: 2024-09-12 02:09:59.649400311 +0000 UTC m=+0.016014463 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:09:59.843 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:59 smithi100 podman[91323]: 2024-09-12 02:09:59.750007438 +0000 UTC m=+0.116621591 container create f2a1143667f9981ea8a90299727992cc9a33f965c669ee3741d1611deb2e9bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T02:10:00.148 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:59 smithi100 podman[91323]: 2024-09-12 02:09:59.952933194 +0000 UTC m=+0.319547357 container init f2a1143667f9981ea8a90299727992cc9a33f965c669ee3741d1611deb2e9bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:10:00.148 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:09:59 smithi100 podman[91323]: 2024-09-12 02:09:59.956330745 +0000 UTC m=+0.322944901 container start f2a1143667f9981ea8a90299727992cc9a33f965c669ee3741d1611deb2e9bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:10:00.148 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:10:00 smithi100 podman[91323]: 2024-09-12 02:10:00.036134064 +0000 UTC m=+0.402748222 container attach f2a1143667f9981ea8a90299727992cc9a33f965c669ee3741d1611deb2e9bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T02:10:00.438 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 12 02:10:00 smithi100 podman[91323]: 2024-09-12 02:10:00.148680409 +0000 UTC m=+0.515294564 container died f2a1143667f9981ea8a90299727992cc9a33f965c669ee3741d1611deb2e9bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:10:00.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T02:10:00.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:00.772 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T02:10:00.773 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T02:10:00.773 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.1 2024-09-12T02:10:01.051 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:00 smithi117 systemd[1]: Stopping Ceph osd.1 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:01.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1[39701]: 2024-09-12T02:10:01.074+0000 7f35a1477640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:01.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1[39701]: 2024-09-12T02:10:01.074+0000 7f35a1477640 -1 osd.1 85 *** Got signal Terminated *** 2024-09-12T02:10:01.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1[39701]: 2024-09-12T02:10:01.074+0000 7f35a1477640 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:06.778 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:06 smithi117 podman[68972]: 2024-09-12 02:10:06.523525517 +0000 UTC m=+5.557530578 container died f74504c486fd62aa9c8928df023c8d0e7d9efe0e2f398fc761f724d4ba5f8fd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T02:10:07.150 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:06 smithi117 podman[68972]: 2024-09-12 02:10:06.96057479 +0000 UTC m=+5.994579897 container cleanup f74504c486fd62aa9c8928df023c8d0e7d9efe0e2f398fc761f724d4ba5f8fd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:10:07.150 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:06 smithi117 bash[68972]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1 2024-09-12T02:10:07.635 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:07 smithi117 podman[69000]: 2024-09-12 02:10:07.228716705 +0000 UTC m=+0.701054198 container remove f74504c486fd62aa9c8928df023c8d0e7d9efe0e2f398fc761f724d4ba5f8fd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:10:07.900 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:07 smithi117 podman[69091]: 2024-09-12 02:10:07.538470686 +0000 UTC m=+0.016041708 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:07.900 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:07 smithi117 podman[69091]: 2024-09-12 02:10:07.646011899 +0000 UTC m=+0.123582990 container create bdc43ec234e83d015e6ef6da0beb16537086441f7f1d33f1324a0b0e0a942937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:10:07.900 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:07 smithi117 podman[69091]: 2024-09-12 02:10:07.864905484 +0000 UTC m=+0.342476509 container init bdc43ec234e83d015e6ef6da0beb16537086441f7f1d33f1324a0b0e0a942937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:10:07.900 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:07 smithi117 podman[69091]: 2024-09-12 02:10:07.868243127 +0000 UTC m=+0.345814150 container start bdc43ec234e83d015e6ef6da0beb16537086441f7f1d33f1324a0b0e0a942937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T02:10:08.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:07 smithi117 podman[69091]: 2024-09-12 02:10:07.948358348 +0000 UTC m=+0.425929376 container attach bdc43ec234e83d015e6ef6da0beb16537086441f7f1d33f1324a0b0e0a942937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T02:10:08.400 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 12 02:10:08 smithi117 podman[69091]: 2024-09-12 02:10:08.055877336 +0000 UTC m=+0.533448359 container died bdc43ec234e83d015e6ef6da0beb16537086441f7f1d33f1324a0b0e0a942937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:10:08.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T02:10:08.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:08.722 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T02:10:08.722 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T02:10:08.722 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.2 2024-09-12T02:10:09.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:08 smithi189 systemd[1]: Stopping Ceph osd.2 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:09.593 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2[40180]: 2024-09-12T02:10:09.135+0000 7f0a12598640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:09.593 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2[40180]: 2024-09-12T02:10:09.135+0000 7f0a12598640 -1 osd.2 85 *** Got signal Terminated *** 2024-09-12T02:10:09.593 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2[40180]: 2024-09-12T02:10:09.135+0000 7f0a12598640 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:14.751 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:14 smithi189 podman[69499]: 2024-09-12 02:10:14.446416898 +0000 UTC m=+5.523508968 container died ffdec48412bf536d836101eeddbb250123797c88ff6696ef8a49e920213e9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:10:15.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:14 smithi189 podman[69499]: 2024-09-12 02:10:14.834106742 +0000 UTC m=+5.911198820 container cleanup ffdec48412bf536d836101eeddbb250123797c88ff6696ef8a49e920213e9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:10:15.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:14 smithi189 bash[69499]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2 2024-09-12T02:10:15.446 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:15 smithi189 podman[69514]: 2024-09-12 02:10:15.118524511 +0000 UTC m=+0.663617729 container remove ffdec48412bf536d836101eeddbb250123797c88ff6696ef8a49e920213e9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T02:10:15.699 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:15 smithi189 podman[69602]: 2024-09-12 02:10:15.349441386 +0000 UTC m=+0.015651930 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:15.699 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:15 smithi189 podman[69602]: 2024-09-12 02:10:15.452558026 +0000 UTC m=+0.118768563 container create eda1b42285a1168d8f4808afd1d1d346ee44902ef319160e71886a1929c6260d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:15.699 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:15 smithi189 podman[69602]: 2024-09-12 02:10:15.696854139 +0000 UTC m=+0.363064678 container init eda1b42285a1168d8f4808afd1d1d346ee44902ef319160e71886a1929c6260d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:15.700 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:15 smithi189 podman[69602]: 2024-09-12 02:10:15.700122997 +0000 UTC m=+0.366333544 container start eda1b42285a1168d8f4808afd1d1d346ee44902ef319160e71886a1929c6260d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T02:10:16.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:15 smithi189 podman[69602]: 2024-09-12 02:10:15.81360096 +0000 UTC m=+0.479811507 container attach eda1b42285a1168d8f4808afd1d1d346ee44902ef319160e71886a1929c6260d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:10:16.093 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 02:10:15 smithi189 podman[69602]: 2024-09-12 02:10:15.893768508 +0000 UTC m=+0.559979046 container died eda1b42285a1168d8f4808afd1d1d346ee44902ef319160e71886a1929c6260d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:16.473 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T02:10:16.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:16.513 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T02:10:16.513 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T02:10:16.513 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.3 2024-09-12T02:10:16.816 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:16 smithi100 systemd[1]: Stopping Ceph osd.3 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:17.070 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:16 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3[51680]: 2024-09-12T02:10:16.816+0000 7f3cb08e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:17.073 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:16 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3[51680]: 2024-09-12T02:10:16.816+0000 7f3cb08e1640 -1 osd.3 85 *** Got signal Terminated *** 2024-09-12T02:10:17.075 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:16 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3[51680]: 2024-09-12T02:10:16.816+0000 7f3cb08e1640 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:19.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:19 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:19.586+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:19.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:19 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:19.449+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:19.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:19.532+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:19.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:19 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:19.569+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:20.734 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:20.482+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:20.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:20.604+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:20.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:20 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:20.470+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:20.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:20 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:20.526+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:21.093 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:20.733+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:21.691 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:21.463+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:21.692 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:21.426+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:21.818 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:21 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3[51680]: 2024-09-12T02:10:21.398+0000 7f3ca8ede640 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:55.288023+0000 front 2024-09-12T02:09:55.288049+0000 (oldest deadline 2024-09-12T02:10:20.588155+0000) 2024-09-12T02:10:21.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:21 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:21.480+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:21.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:21 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:21.560+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:21.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:21 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:21.540+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:21.900 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:21 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:21.616+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:22.093 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:21.691+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:22.465 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:22 smithi100 podman[91427]: 2024-09-12 02:10:22.204352616 +0000 UTC m=+5.495237995 container died e3b0db0a67d2a765872dcb92270403a4bb517d11fe377a97a777889eb5b93f54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:10:22.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:22 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:22.555+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:22.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:22 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:22.464+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:22.819 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:22 smithi100 podman[91427]: 2024-09-12 02:10:22.641485919 +0000 UTC m=+5.932371296 container cleanup e3b0db0a67d2a765872dcb92270403a4bb517d11fe377a97a777889eb5b93f54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:10:22.819 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:22 smithi100 bash[91427]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3 2024-09-12T02:10:22.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:22.705+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:22.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:22.474+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:22.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:22.476+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:22.900 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:22.576+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:22.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:22 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:22.563+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:23.251 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:22 smithi100 podman[91443]: 2024-09-12 02:10:22.842937075 +0000 UTC m=+0.634127253 container remove e3b0db0a67d2a765872dcb92270403a4bb517d11fe377a97a777889eb5b93f54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:23.510 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:23 smithi100 podman[91536]: 2024-09-12 02:10:23.25211543 +0000 UTC m=+0.111159569 container create e643a42563d172708180f310d5b5e2cb3dd6ab6034ffb97de266945b86e54417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:23.510 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:23 smithi100 podman[91536]: 2024-09-12 02:10:23.156691101 +0000 UTC m=+0.015735242 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:23.510 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:23 smithi100 podman[91536]: 2024-09-12 02:10:23.462594332 +0000 UTC m=+0.321638465 container init e643a42563d172708180f310d5b5e2cb3dd6ab6034ffb97de266945b86e54417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:10:23.510 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:23 smithi100 podman[91536]: 2024-09-12 02:10:23.465801339 +0000 UTC m=+0.324845472 container start e643a42563d172708180f310d5b5e2cb3dd6ab6034ffb97de266945b86e54417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:10:23.511 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:23.477+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:23.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:23 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:23.509+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:23.819 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:23 smithi100 podman[91536]: 2024-09-12 02:10:23.571192294 +0000 UTC m=+0.430236444 container attach e643a42563d172708180f310d5b5e2cb3dd6ab6034ffb97de266945b86e54417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:10:23.819 INFO:journalctl@ceph.osd.3.smithi100.stdout:Sep 12 02:10:23 smithi100 podman[91536]: 2024-09-12 02:10:23.656138722 +0000 UTC m=+0.515182855 container died e643a42563d172708180f310d5b5e2cb3dd6ab6034ffb97de266945b86e54417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:10:23.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:23.450+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:23.453+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:23.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:23.675+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:23.900 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:23 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:23.603+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:23.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:23 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:23.535+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:24.401 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T02:10:24.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:24.445 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T02:10:24.445 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T02:10:24.446 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.4 2024-09-12T02:10:24.745 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:24 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:24.525+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:24.745 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:24 smithi117 systemd[1]: Stopping Ceph osd.4 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:24.745 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:24 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:24.628+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:24.745 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:24 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:24.744+0000 7f89263c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:24.745 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:24 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:24.744+0000 7f89263c7640 -1 osd.4 85 *** Got signal Terminated *** 2024-09-12T02:10:24.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:24 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:24.507+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:24.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:24 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:24.447+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:24.842 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:24 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:24.487+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:24.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:24 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:24.425+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:24.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:24 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:24.659+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:25.150 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:24 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:24.744+0000 7f89263c7640 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:25.692 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:25 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:25.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:25.692 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:25 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:25.532+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:25.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:25 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:25.555+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:25.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:25 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:25.464+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:25.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:25 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:25.498+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:25.900 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:25 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:25.656+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:26.093 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:25 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:25.692+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:26.692 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:26 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:26.577+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:26.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:26 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:26.390+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:26.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:26 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:26.567+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:26.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:26 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:26.418+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:26.900 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:26 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:26.698+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:26.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:26 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:26.540+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:27.093 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:26 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:26.692+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:27.820 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:27 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:27.597+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:27.820 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:27 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:27.431+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:27.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:27 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:27.644+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:27.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:27 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:27.574+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:27.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:27 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:27.394+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:27.900 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:27 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:27.735+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:27.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:27 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:27.505+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:28.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:28 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:28.554+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:28.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:28 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:28.420+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:28.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:28 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:28.602+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:28.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:28 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:28.570+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:28.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:28 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:28.382+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:28.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:28 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:28.382+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:28.900 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:28 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4[46659]: 2024-09-12T02:10:28.756+0000 7f89229cc640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.158266+0000 front 2024-09-12T02:09:57.158317+0000 (oldest deadline 2024-09-12T02:10:21.258456+0000) 2024-09-12T02:10:28.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:28 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:28.532+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:29.818 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:29 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:29.396+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:29.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:29 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:29.534+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:29.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:29 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:29.534+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:29.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:29 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:29.618+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:29.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:29 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:29.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:29.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:29 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:29.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:29.844 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:29 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:29.559+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:29.844 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:29 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:29.559+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:29.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:29 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:29.579+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:29.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:29 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:29.579+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:30.528 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:30 smithi117 podman[69194]: 2024-09-12 02:10:30.274595685 +0000 UTC m=+5.625253509 container died eee99d73db972dd48710f600cfc89ee9cc5c38edc11a1fe2962b78eab7e05b5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:10:30.803 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:30 smithi117 podman[69194]: 2024-09-12 02:10:30.62016633 +0000 UTC m=+5.970824156 container cleanup eee99d73db972dd48710f600cfc89ee9cc5c38edc11a1fe2962b78eab7e05b5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T02:10:30.803 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:30 smithi117 bash[69194]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4 2024-09-12T02:10:30.803 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:30 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:30.534+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:30.803 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:30 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:30.534+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:30.818 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:30 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:30.374+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:30.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:30 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:30.578+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:30.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:30 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:30.578+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:30.842 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:30 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:30.619+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:30.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:30 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:30.545+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:30.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:30 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:30.545+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:30.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:30 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:30.380+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:30.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:30 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:30.380+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:31.150 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:30 smithi117 podman[69209]: 2024-09-12 02:10:30.803562208 +0000 UTC m=+0.528010028 container remove eee99d73db972dd48710f600cfc89ee9cc5c38edc11a1fe2962b78eab7e05b5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:10:31.522 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:31 smithi117 podman[69301]: 2024-09-12 02:10:31.220954146 +0000 UTC m=+0.098468021 container create 23029a806a900c63ded226ce4b83daa402b05efda5d97d4de2290f1d42b2c98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:10:31.523 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:31 smithi117 podman[69301]: 2024-09-12 02:10:31.1383508 +0000 UTC m=+0.015864631 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:31.523 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:31 smithi117 podman[69301]: 2024-09-12 02:10:31.448533174 +0000 UTC m=+0.326047013 container init 23029a806a900c63ded226ce4b83daa402b05efda5d97d4de2290f1d42b2c98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:10:31.523 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:31 smithi117 podman[69301]: 2024-09-12 02:10:31.451970883 +0000 UTC m=+0.329484716 container start 23029a806a900c63ded226ce4b83daa402b05efda5d97d4de2290f1d42b2c98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:10:31.523 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:31 smithi117 podman[69301]: 2024-09-12 02:10:31.52313155 +0000 UTC m=+0.400645394 container attach 23029a806a900c63ded226ce4b83daa402b05efda5d97d4de2290f1d42b2c98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:10:31.601 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:31 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:31.348+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:31.601 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:31 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:31.348+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:31.601 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:31 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:31.546+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:31.601 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:31 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:31.546+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:31.814 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 12 02:10:31 smithi117 podman[69301]: 2024-09-12 02:10:31.640158364 +0000 UTC m=+0.517672193 container died 23029a806a900c63ded226ce4b83daa402b05efda5d97d4de2290f1d42b2c98d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:10:31.815 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:31 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:31.571+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:31.815 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:31 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:31.571+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:31.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:31 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:31.600+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:31.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:31 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:31.600+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:31.818 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:31 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:31.363+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:31.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:31 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:31.363+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:32.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:31 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:31.601+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:32.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:31 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:31.814+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:32.222 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T02:10:32.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:32.262 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T02:10:32.262 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T02:10:32.262 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.5 2024-09-12T02:10:32.540 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:32 smithi189 systemd[1]: Stopping Ceph osd.5 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:32.540 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:32.325+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:32.540 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:32.325+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:32.814 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:32 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:32.593+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:32.815 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:32 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:32.593+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:32.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:32 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:32.569+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:32.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:32 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:32.569+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:32.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:32 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:32.353+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:32.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:32 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:32.353+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:32.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:32.561+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:32.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:32.540+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:32.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:32.540+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:32.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:32.569+0000 7fcb19549640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:32.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:32.569+0000 7fcb19549640 -1 osd.5 85 *** Got signal Terminated *** 2024-09-12T02:10:32.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:32 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:32.569+0000 7fcb19549640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:33.149 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:32 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:32.814+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:33.567 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:33 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:33.305+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:33.567 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:33 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:33.305+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:33.796 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:33 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:33.632+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:33.796 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:33 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:33.632+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:33.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:33 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:33.567+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:33.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:33 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:33.567+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:33.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:33 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:33.518+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:33.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:33 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:33.538+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:33.843 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:33 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:33.538+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:33.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:33 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:33.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:33.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:33 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:33.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:34.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:33 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:33.797+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:34.568 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:34 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:34.314+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:34.568 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:34 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:34.314+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:34.568 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:34 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:34.525+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:34.568 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:34 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:34.525+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:34.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:34 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:34.558+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:34.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:34 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:34.558+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:34.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:34 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:34.318+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:34.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:34 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:34.318+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:34.842 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:34 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:34.568+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:34.900 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:34 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:34.826+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:34.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:34 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:34.635+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:34.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:34 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:34.635+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:35.568 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:35 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:35.524+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:35.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:35 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:35.524+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:35.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:35 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:35.524+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:35.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:35 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:35.276+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:35.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:35 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:35.276+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:35.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:35 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:35.534+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:35.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:35 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:35.534+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:35.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:35 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:35.295+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:35.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:35 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:35.295+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:35.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:35 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:35.295+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:36.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:35 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:35.616+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:36.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:35 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:35.616+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:36.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:35 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:35.835+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:36.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:35 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:35.665+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:36.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:35 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:35.665+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:36.568 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:36 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:36.492+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:36.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:36 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:36.492+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:36.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:36 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:36.492+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:36.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:36 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:36.252+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:36.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:36 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:36.252+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:36.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:36 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:36.531+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.158531+0000 front 2024-09-12T02:09:54.158509+0000 (oldest deadline 2024-09-12T02:10:20.058626+0000) 2024-09-12T02:10:36.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:36 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5[47153]: 2024-09-12T02:10:36.531+0000 7fcb15b4e640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.260512+0000 front 2024-09-12T02:10:05.260332+0000 (oldest deadline 2024-09-12T02:10:28.760368+0000) 2024-09-12T02:10:36.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:36 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:36.295+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:36.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:36 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:36.295+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:36.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:36 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:36.295+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:36.900 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:36 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:36.807+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:36.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:36 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:36.640+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:36.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:36 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:36.640+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:36.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:36 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:36.640+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:37.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:36 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:36.652+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:37.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:36 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:36.652+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:37.542 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:37 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:37.284+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:37.542 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:37 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:37.284+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:37.542 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:37 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:37.284+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:37.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:37.292+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:37.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:37.292+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:37.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:37.292+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:37.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:37 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:37.541+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:37.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:37 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:37.541+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:37.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:37 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:37.541+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:38.029 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:37.690+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:38.029 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:37 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:37.690+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:38.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:37.786+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:38.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:37.688+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:38.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:37.688+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:38.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:37 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:37.688+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:38.343 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:38 smithi189 podman[69705]: 2024-09-12 02:10:38.029395872 +0000 UTC m=+5.573198909 container died ce2b2a7de6f8329500db226bb2419c21cf40c547fc77c5c789c63d0cf7c95f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:10:38.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:38 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:38.255+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:38.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:38 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:38.255+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:38.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:38 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:38.255+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:38.679 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:38 smithi189 podman[69705]: 2024-09-12 02:10:38.369365498 +0000 UTC m=+5.913168531 container cleanup ce2b2a7de6f8329500db226bb2419c21cf40c547fc77c5c789c63d0cf7c95f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:10:38.679 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:38 smithi189 bash[69705]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5 2024-09-12T02:10:38.679 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:38 smithi189 podman[69720]: 2024-09-12 02:10:38.545081073 +0000 UTC m=+0.518156355 container remove ce2b2a7de6f8329500db226bb2419c21cf40c547fc77c5c789c63d0cf7c95f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:10:38.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:38 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:38.564+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:38.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:38 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:38.564+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:38.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:38 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:38.564+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:38.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:38 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:38.322+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:38.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:38 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:38.322+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:38.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:38 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:38.322+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:38.980 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:38 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:38.679+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:38.980 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:38 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:38.679+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:39.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:38.763+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:39.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:38.763+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:39.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:38.665+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:39.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:38.665+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:39.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:38 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:38.665+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:39.243 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:38 smithi189 podman[69810]: 2024-09-12 02:10:38.883111247 +0000 UTC m=+0.016114979 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:39.244 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:39 smithi189 podman[69810]: 2024-09-12 02:10:39.004304434 +0000 UTC m=+0.137308198 container create a5441ae943991dd0d0492aa59b4ddd1cff8b5f76111e022d8c5a4eac21cc66c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:10:39.244 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:39 smithi189 podman[69810]: 2024-09-12 02:10:39.206523662 +0000 UTC m=+0.339527380 container init a5441ae943991dd0d0492aa59b4ddd1cff8b5f76111e022d8c5a4eac21cc66c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:10:39.244 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:39 smithi189 podman[69810]: 2024-09-12 02:10:39.209827648 +0000 UTC m=+0.342831381 container start a5441ae943991dd0d0492aa59b4ddd1cff8b5f76111e022d8c5a4eac21cc66c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:10:39.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:39 smithi189 podman[69810]: 2024-09-12 02:10:39.281459469 +0000 UTC m=+0.414463191 container attach a5441ae943991dd0d0492aa59b4ddd1cff8b5f76111e022d8c5a4eac21cc66c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T02:10:39.593 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 02:10:39 smithi189 podman[69810]: 2024-09-12 02:10:39.398900933 +0000 UTC m=+0.531904669 container died a5441ae943991dd0d0492aa59b4ddd1cff8b5f76111e022d8c5a4eac21cc66c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T02:10:39.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:39 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:39.243+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:39.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:39 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:39.243+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:39.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:39 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:39.243+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:39.818 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:39 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:39.528+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:39.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:39 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:39.528+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:39.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:39 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:39.528+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:39.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:39 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:39.323+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:39.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:39 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:39.324+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:39.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:39 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:39.324+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:39.934 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:39 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:39.670+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:39.934 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:39 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:39.670+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:39.952 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T02:10:39.991 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:39.991 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T02:10:39.991 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T02:10:39.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.6 2024-09-12T02:10:40.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:39 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:39.786+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:40.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:39 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:39.786+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:40.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:39 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:39.694+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:40.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:39 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:39.694+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:40.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:39 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:39.694+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:40.310 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:40 smithi100 systemd[1]: Stopping Ceph osd.6 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:40.495 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:40 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:40.216+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:40.495 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:40 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:40.216+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:40.495 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:40 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:40.216+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:40.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:40.312+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:40.312+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:40.312+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:40.310+0000 7f0a06345640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:40.310+0000 7f0a06345640 -1 osd.6 85 *** Got signal Terminated *** 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:40.310+0000 7f0a06345640 -1 osd.6 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:40.522+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:40.522+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:40.569 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:40.522+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:40.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:40 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:40.627+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:40.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:40 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:40.627+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:41.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:40 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:40.779+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:41.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:40 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:40.779+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:41.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:40 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:40.680+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:41.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:40 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:40.680+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:41.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:40 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:40.680+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:41.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:41 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:41.229+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:41.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:41 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:41.229+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:41.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:41 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:41.229+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:41.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:41 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:41.552+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:41.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:41 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:41.552+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:41.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:41 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:41.552+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:41.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:41 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:41.329+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:41.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:41 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:41.329+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:41.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:41 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:41.329+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:42.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:41 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:41.629+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:42.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:41 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:41.629+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:42.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:41 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:41.736+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:42.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:41 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:41.736+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:42.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:41 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:41.671+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:42.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:41 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:41.671+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:42.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:41 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:41.671+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:42.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:42 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:42.241+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:42.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:42 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:42.241+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:42.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:42 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:42.241+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:42.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:42 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:42.527+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:42.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:42 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:42.527+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:42.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:42 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:42.527+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:42.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:42 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:42.355+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:42.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:42 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:42.355+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:42.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:42 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:42.355+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:43.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:42 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:42.646+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:43.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:42 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:42.646+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:43.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:42 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:42.698+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:43.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:42 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:42.698+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:43.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:42 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:42.721+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:43.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:42 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:42.721+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:43.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:42 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:42.721+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:43.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:43.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:43.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:43.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:43.594 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:43.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:43.594 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:43.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:43.762 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:43 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:43.717+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:43.762 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:43 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:43.717+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:43.818 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:43.404+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:43.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:43.404+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:43.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:43.404+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:43.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:43.573+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:43.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:43.573+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:43.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:43.573+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:43.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:43 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:43.573+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.289859+0000 front 2024-09-12T02:10:19.289814+0000 (oldest deadline 2024-09-12T02:10:42.789966+0000) 2024-09-12T02:10:44.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:43.638+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:44.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:43.638+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:44.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:43 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:43.638+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:44.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:43 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:43.761+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:44.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:43 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:43.761+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:44.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:43 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:43.761+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:44.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:44 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:44.210+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:44.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:44 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:44.210+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:44.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:44 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:44.210+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:44.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:44 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:44.210+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:44.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:44.361+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:44.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:44.361+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:44.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:44.361+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:44.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:44.604+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.186406+0000 front 2024-09-12T02:09:57.186430+0000 (oldest deadline 2024-09-12T02:10:19.486543+0000) 2024-09-12T02:10:44.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:44.604+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.287959+0000 front 2024-09-12T02:10:05.288076+0000 (oldest deadline 2024-09-12T02:10:29.387924+0000) 2024-09-12T02:10:44.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:44.604+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.889120+0000 front 2024-09-12T02:10:12.888997+0000 (oldest deadline 2024-09-12T02:10:35.188896+0000) 2024-09-12T02:10:44.819 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:44 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6[58221]: 2024-09-12T02:10:44.604+0000 7f0a0294a640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.289859+0000 front 2024-09-12T02:10:19.289814+0000 (oldest deadline 2024-09-12T02:10:42.789966+0000) 2024-09-12T02:10:45.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:44 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:44.620+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:45.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:44 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:44.620+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:45.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:44 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:44.620+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:45.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:44 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:44.746+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:45.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:44 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:44.746+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:45.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:44 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:44.789+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:45.152 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:44 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:44.789+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:45.152 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:44 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:44.789+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:45.152 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:44 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:44.789+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:45.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:45 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:45.213+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:45.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:45 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:45.213+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:45.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:45 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:45.213+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:45.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:45 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:45.213+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:45.626 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:45 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:45.343+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:45.626 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:45 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:45.343+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:45.626 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:45 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:45.343+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:45.927 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:45 smithi100 podman[91638]: 2024-09-12 02:10:45.626696914 +0000 UTC m=+5.435670532 container died db75a9eb07e29ab891f3433f0682ba8191e1221d5f21a5d3c9b98774058bf0ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T02:10:46.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:45 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:45.608+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:46.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:45 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:45.608+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:46.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:45 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:45.608+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:46.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:45.785+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:46.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:45.785+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:46.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:45.820+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:46.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:45.820+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:46.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:45.820+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:46.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:45.820+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:46.319 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:46 smithi100 podman[91638]: 2024-09-12 02:10:46.110763623 +0000 UTC m=+5.919737238 container cleanup db75a9eb07e29ab891f3433f0682ba8191e1221d5f21a5d3c9b98774058bf0ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-12T02:10:46.319 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:46 smithi100 bash[91638]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6 2024-09-12T02:10:46.572 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:46.174+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:46.572 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:46.174+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:46.573 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:46.174+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:46.573 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:46.174+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:46.723 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:46 smithi100 podman[91653]: 2024-09-12 02:10:46.370773527 +0000 UTC m=+0.740931625 container remove db75a9eb07e29ab891f3433f0682ba8191e1221d5f21a5d3c9b98774058bf0ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:46.723 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:46 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:46.318+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:46.724 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:46 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:46.318+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:46.724 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:46 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:46.318+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:46.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:46.572+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:46.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:46.572+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:46.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:46 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:46.572+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:47.015 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:46 smithi100 podman[91740]: 2024-09-12 02:10:46.626745195 +0000 UTC m=+0.015630038 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:47.016 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:46 smithi100 podman[91740]: 2024-09-12 02:10:46.729939069 +0000 UTC m=+0.118823898 container create 1770a9c2ec4bbc5c7cbecfd3828280c721049a003b4ba76149f23a78841eeae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T02:10:47.016 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:47 smithi100 podman[91740]: 2024-09-12 02:10:47.015946059 +0000 UTC m=+0.404830888 container init 1770a9c2ec4bbc5c7cbecfd3828280c721049a003b4ba76149f23a78841eeae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T02:10:47.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:46.748+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:47.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:46.748+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:47.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:46.847+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:47.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:46.847+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:47.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:46.847+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:47.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:46 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:46.847+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:47.318 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:47 smithi100 podman[91740]: 2024-09-12 02:10:47.01941059 +0000 UTC m=+0.408295431 container start 1770a9c2ec4bbc5c7cbecfd3828280c721049a003b4ba76149f23a78841eeae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T02:10:47.319 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:47 smithi100 podman[91740]: 2024-09-12 02:10:47.107390158 +0000 UTC m=+0.496275024 container attach 1770a9c2ec4bbc5c7cbecfd3828280c721049a003b4ba76149f23a78841eeae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T02:10:47.319 INFO:journalctl@ceph.osd.6.smithi100.stdout:Sep 12 02:10:47 smithi100 podman[91740]: 2024-09-12 02:10:47.208798462 +0000 UTC m=+0.597683301 container died 1770a9c2ec4bbc5c7cbecfd3828280c721049a003b4ba76149f23a78841eeae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:10:47.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:47.224+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:47.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:47.224+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:47.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:47.224+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:47.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:47.224+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:47.818 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:47.328+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:47.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:47.329+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:47.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:47 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:47.329+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:47.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T02:10:47.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:47.889 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T02:10:47.889 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T02:10:47.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.7 2024-09-12T02:10:48.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:47.595+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:48.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:47.595+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:48.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:47 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:47.595+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:48.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:47 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:47.755+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:48.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:47 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:47.755+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:48.151 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:47 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:47.755+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.426336+0000 front 2024-09-12T02:10:21.426426+0000 (oldest deadline 2024-09-12T02:10:47.326327+0000) 2024-09-12T02:10:48.151 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:47 smithi117 systemd[1]: Stopping Ceph osd.7 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:48.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:47 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:47.855+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:48.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:47 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:47.855+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:48.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:47 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:47.855+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:48.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:47 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:47.855+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:48.284 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:48 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:48.283+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:48.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:48 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:48.283+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:48.572 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:48 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:48.283+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:48.573 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:48 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:48.283+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:48.575 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:48.190+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:48.575 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:48.190+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:48.576 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:48.190+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:48.576 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:48.190+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:48.650 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:48.209+0000 7fbc89a01640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:48.650 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:48.209+0000 7fbc89a01640 -1 osd.7 85 *** Got signal Terminated *** 2024-09-12T02:10:48.650 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:48.209+0000 7fbc89a01640 -1 osd.7 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:48.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:48.576+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:48.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:48.576+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:48.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:48 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:48.576+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:49.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:48.886+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:49.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:48.886+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:49.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:48.886+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:49.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:48.886+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:49.151 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:48.708+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:49.151 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:48.708+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:49.151 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:48 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:48.708+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.426336+0000 front 2024-09-12T02:10:21.426426+0000 (oldest deadline 2024-09-12T02:10:47.326327+0000) 2024-09-12T02:10:49.554 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:49 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:49.287+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:49.554 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:49 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:49.287+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:49.555 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:49 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:49.287+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:49.555 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:49 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:49.287+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:49.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:49 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:49.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:49.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:49 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:49.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:49.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:49 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:49.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:49.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:49 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:49.233+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:50.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:49 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:49.625+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:50.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:49 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:49.625+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:50.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:49 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:49.625+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:50.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:49 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:49.714+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:50.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:49 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:49.714+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:50.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:49 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:49.714+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.426336+0000 front 2024-09-12T02:10:21.426426+0000 (oldest deadline 2024-09-12T02:10:47.326327+0000) 2024-09-12T02:10:50.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:49 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:49.892+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:50.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:49 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:49.892+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:50.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:49 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:49.892+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:50.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:49 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:49.892+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:50.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:50 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:50.299+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:50.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:50 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:50.299+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:50.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:50 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:50.299+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:50.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:50 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:50.299+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:50.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:50 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:50.229+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:50.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:50 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:50.229+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:50.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:50 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:50.229+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:50.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:50 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:50.229+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:51.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:50 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:50.652+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:51.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:50 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:50.652+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:51.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:50 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:50.652+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:51.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:50.666+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:51.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:50.666+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:51.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:50.666+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.426336+0000 front 2024-09-12T02:10:21.426426+0000 (oldest deadline 2024-09-12T02:10:47.326327+0000) 2024-09-12T02:10:51.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:50.878+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:51.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:50.878+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:51.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:50.878+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:51.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:50.878+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:51.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:51 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:51.250+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:51.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:51 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:51.250+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:51.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:51 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:51.250+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:51.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:51 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:51.250+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:51.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:51 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:51.260+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:51.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:51 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:51.260+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:51.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:51 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:51.260+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:51.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:51 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:51.260+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:52.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:51 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:51.680+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:52.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:51 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:51.680+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:52.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:51 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:51.680+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:52.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:51.692+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:52.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:51.692+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:52.150 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:51.692+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.426336+0000 front 2024-09-12T02:10:21.426426+0000 (oldest deadline 2024-09-12T02:10:47.326327+0000) 2024-09-12T02:10:52.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:51.912+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:52.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:51.912+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:52.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:51.912+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:52.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:51.912+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:52.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:51 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:51.912+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:52.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:52.278+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:52.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:52.278+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:52.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:52.278+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:52.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:52.278+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:52.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:52 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:52.278+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:52.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:52.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:52.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:52.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:52.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:52.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:52.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:52.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:52.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:52.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:52.645+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.723648+0000 front 2024-09-12T02:10:05.723787+0000 (oldest deadline 2024-09-12T02:10:31.524245+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:52.645+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.524706+0000 front 2024-09-12T02:10:11.524718+0000 (oldest deadline 2024-09-12T02:10:38.525347+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7[53643]: 2024-09-12T02:10:52.645+0000 7fbc81ffe640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.426336+0000 front 2024-09-12T02:10:21.426426+0000 (oldest deadline 2024-09-12T02:10:47.326327+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:52.867+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:52.867+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:52.867+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:52.867+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:52.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:52 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:52.867+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:53.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:52.669+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:53.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:52.669+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:53.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:52 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:52.669+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:53.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:53.270+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:53.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:53.270+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:53.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:53.270+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:53.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:53.270+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:53.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:53 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:53.270+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:53.596 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:53.305+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:53.597 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:53.305+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:53.597 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:53.305+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:53.597 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:53.305+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:53.597 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:53.305+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:10:53.986 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:53 smithi117 podman[69414]: 2024-09-12 02:10:53.703591857 +0000 UTC m=+5.612571811 container died f66fcf8adce7588bd6593b92fee5fc34395f3b507e7d2834cdd68e8589f9cdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:10:53.986 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:53 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:53.842+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:53.986 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:53 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:53.842+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:53.986 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:53 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:53.842+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:53.986 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:53 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:53.842+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:53.986 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:53 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:53.842+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:54.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:53.641+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:54.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:53.641+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:54.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:53.641+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:54.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:53 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:53.641+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:10:54.395 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:54 smithi117 podman[69414]: 2024-09-12 02:10:54.085473449 +0000 UTC m=+5.994453404 container cleanup f66fcf8adce7588bd6593b92fee5fc34395f3b507e7d2834cdd68e8589f9cdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:54.395 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:54 smithi117 bash[69414]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7 2024-09-12T02:10:54.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:54.252+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:54.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:54.252+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:54.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:54.252+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:54.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:54.252+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:54.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:54 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:54.252+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:54.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:54.266+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:54.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:54.266+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:54.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:54.266+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:54.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:54.266+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:54.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:54.266+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:10:54.650 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:54 smithi117 podman[69431]: 2024-09-12 02:10:54.395151312 +0000 UTC m=+0.681172230 container remove f66fcf8adce7588bd6593b92fee5fc34395f3b507e7d2834cdd68e8589f9cdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:10:55.055 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:54 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:54.797+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:54 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:54.797+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:54 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:54.797+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:54 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:54.797+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:54 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:54.797+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:54 smithi117 podman[69515]: 2024-09-12 02:10:54.657432299 +0000 UTC m=+0.015346388 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:54 smithi117 podman[69515]: 2024-09-12 02:10:54.770917467 +0000 UTC m=+0.128831543 container create fecac6fdf52bc23deef67c431ae651219e2fbdcfe765aa4306da964345ddd0b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:54 smithi117 podman[69515]: 2024-09-12 02:10:54.964702567 +0000 UTC m=+0.322616643 container init fecac6fdf52bc23deef67c431ae651219e2fbdcfe765aa4306da964345ddd0b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:54 smithi117 podman[69515]: 2024-09-12 02:10:54.96814071 +0000 UTC m=+0.326054787 container start fecac6fdf52bc23deef67c431ae651219e2fbdcfe765aa4306da964345ddd0b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:55.056 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:55 smithi117 podman[69515]: 2024-09-12 02:10:55.05625074 +0000 UTC m=+0.414164826 container attach fecac6fdf52bc23deef67c431ae651219e2fbdcfe765aa4306da964345ddd0b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:10:55.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:54.645+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:55.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:54.645+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:55.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:54.645+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:55.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:54 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:54.645+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:10:55.321 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 12 02:10:55 smithi117 podman[69515]: 2024-09-12 02:10:55.164702771 +0000 UTC m=+0.522616867 container died fecac6fdf52bc23deef67c431ae651219e2fbdcfe765aa4306da964345ddd0b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T02:10:55.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:55 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:55.215+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:55.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:55 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:55.215+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:55.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:55 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:55.215+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:55.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:55 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:55.215+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:55.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:55 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:55.215+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:55.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:55.302+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:55.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:55.302+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:55.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:55.302+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:55.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:55.302+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:55.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:55.302+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:10:55.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T02:10:55.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:55.786 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T02:10:55.787 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T02:10:55.787 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.8 2024-09-12T02:10:56.087 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:55.673+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:56.088 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:55.673+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:56.088 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:55.673+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:56.088 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:55 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:55.673+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:10:56.088 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:55 smithi189 systemd[1]: Stopping Ceph osd.8 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:10:56.088 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:56.086+0000 7fc492850640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:56.089 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:56.086+0000 7fc492850640 -1 osd.8 85 *** Got signal Terminated *** 2024-09-12T02:10:56.089 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:56.086+0000 7fc492850640 -1 osd.8 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:56.153 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:55 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:55.801+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:56.153 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:55 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:55.801+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:56.153 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:55 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:55.801+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:56.153 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:55 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:55.801+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:56.153 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:55 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:55.801+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:56.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:56.263+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:56.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:56.263+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:56.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:56.263+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:56.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:56.263+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:56.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:56.263+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:10:56.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:56.199+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:56.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:56.199+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:56.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:56.199+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:56.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:56.199+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:56.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:56 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:56.199+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:57.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:56.715+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:57.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:56.715+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:57.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:56.715+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:57.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:56 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:56.715+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:10:57.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:56 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:56.841+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:57.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:56 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:56.841+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:57.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:56 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:56.841+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:57.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:56 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:56.841+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:57.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:56 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:56.841+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:57.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:57.236+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:57.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:57.236+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:57.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:57.236+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:57.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:57.236+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:57.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:57 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:57.236+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:57.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:57.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:57.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:57.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:57.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:57.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:57.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:57.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:57.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:57.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:10:58.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:57.761+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:58.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:57.761+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:58.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:57.761+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:58.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:57 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:57.761+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:10:58.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:57 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:57.791+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:58.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:57 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:57.791+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:58.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:57 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:57.791+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:58.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:57 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:57.791+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:58.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:57 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:57.791+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:58.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:58 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:58.216+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:58.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:58 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:58.216+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:58.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:58 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:58.216+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:58.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:58 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:58.216+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:58.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:58 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:58.216+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:58.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:58.273+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:58.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:58.273+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:58.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:58.273+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:58.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:58.273+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:58.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:58.273+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:10:59.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:58.773+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:10:59.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:58.773+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:10:59.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:58.773+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:10:59.094 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:58.773+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:10:59.094 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:58 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:58.773+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.162829+0000 front 2024-09-12T02:10:37.162886+0000 (oldest deadline 2024-09-12T02:10:58.262902+0000) 2024-09-12T02:10:59.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:58 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:58.779+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:10:59.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:58 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:58.779+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:10:59.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:58 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:58.779+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:10:59.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:58 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:58.779+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:10:59.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:58 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:58.779+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:10:59.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:59.189+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:10:59.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:59.189+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:10:59.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:59.189+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:10:59.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:59.189+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:10:59.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:59.189+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:10:59.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:10:59 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:10:59.189+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:10:59.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:59.294+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:10:59.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:59.294+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:10:59.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:59.294+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:10:59.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:59.294+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:10:59.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:10:59.294+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:00.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:59.785+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:11:00.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:59.785+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:11:00.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:59.785+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:11:00.094 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:59.785+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:11:00.094 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:10:59 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:10:59.785+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.162829+0000 front 2024-09-12T02:10:37.162886+0000 (oldest deadline 2024-09-12T02:10:58.262902+0000) 2024-09-12T02:11:00.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:59 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:59.770+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:00.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:59 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:59.770+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:00.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:59 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:59.770+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:00.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:59 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:59.770+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:00.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:10:59 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:10:59.770+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:00.319 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:00.220+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:00.319 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:00.220+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:00.319 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:00.220+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:00.319 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:00.220+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:00.319 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:00.220+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:00.319 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:00 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:00.220+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:00.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:00.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:00.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:00.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:00.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:00.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:00.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:00.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:00.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:00.257+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:01.051 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:00 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:00.755+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:01.052 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:00 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:00.755+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:01.052 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:00 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:00.756+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:01.052 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:00 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:00.756+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:01.052 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:00 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:00.756+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:01.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:11:00.795+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:53.456613+0000 front 2024-09-12T02:09:53.456832+0000 (oldest deadline 2024-09-12T02:10:19.356528+0000) 2024-09-12T02:11:01.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:11:00.795+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:09.759006+0000 front 2024-09-12T02:10:09.759162+0000 (oldest deadline 2024-09-12T02:10:35.059138+0000) 2024-09-12T02:11:01.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:11:00.795+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:19.760366+0000 front 2024-09-12T02:10:19.760262+0000 (oldest deadline 2024-09-12T02:10:42.660198+0000) 2024-09-12T02:11:01.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:11:00.795+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.561336+0000 front 2024-09-12T02:10:25.561319+0000 (oldest deadline 2024-09-12T02:10:53.161789+0000) 2024-09-12T02:11:01.093 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:00 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8[53970]: 2024-09-12T02:11:00.795+0000 7fc48ee55640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.162829+0000 front 2024-09-12T02:10:37.162886+0000 (oldest deadline 2024-09-12T02:10:58.262902+0000) 2024-09-12T02:11:01.554 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:01 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:01.250+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:01.554 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:01 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:01.250+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:01.554 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:01 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:01.250+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:01.555 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:01 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:01.250+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:01.555 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:01 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:01.250+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:01.555 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:01 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:01.250+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:01.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:01 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:01.195+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:01.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:01 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:01.195+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:01.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:01 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:01.195+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:01.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:01 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:01.195+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:01.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:01 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:01.195+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:01.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:01 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:01.195+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:01.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:01 smithi189 podman[69925]: 2024-09-12 02:11:01.554738318 +0000 UTC m=+5.569786558 container died 4be5b8c39c5e6d4cdbff36034f8ac701fed067c9cfe845deee9eef88e70a3784 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:02.062 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:01.737+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:02.063 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:01.737+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:02.063 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:01.737+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:02.063 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:01.737+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:02.063 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:01.737+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:02.063 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:01 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:01.737+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:02.187 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:01 smithi189 podman[69925]: 2024-09-12 02:11:01.928511457 +0000 UTC m=+5.943559696 container cleanup 4be5b8c39c5e6d4cdbff36034f8ac701fed067c9cfe845deee9eef88e70a3784 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:11:02.187 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:01 smithi189 bash[69925]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8 2024-09-12T02:11:02.538 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:02 smithi189 podman[69940]: 2024-09-12 02:11:02.187846512 +0000 UTC m=+0.629985788 container remove 4be5b8c39c5e6d4cdbff36034f8ac701fed067c9cfe845deee9eef88e70a3784 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:11:02.538 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:02.232+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:02.538 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:02.232+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:02.538 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:02.232+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:02.538 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:02.232+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:02.538 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:02.232+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:02.539 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:02.232+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:02.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:02 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:02.205+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:02.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:02 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:02.205+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:02.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:02 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:02.205+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:02.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:02 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:02.205+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:02.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:02 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:02.205+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:02.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:02 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:02.205+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:02.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:02 smithi189 podman[70027]: 2024-09-12 02:11:02.538647875 +0000 UTC m=+0.106644031 container create 91c68dca1a8f125e5cba00161229febb56376f4d083d620a7d2e27afe58187d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:02.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:02 smithi189 podman[70027]: 2024-09-12 02:11:02.448289938 +0000 UTC m=+0.016286035 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:02.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:02 smithi189 podman[70027]: 2024-09-12 02:11:02.782784366 +0000 UTC m=+0.350780456 container init 91c68dca1a8f125e5cba00161229febb56376f4d083d620a7d2e27afe58187d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:11:02.843 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:02 smithi189 podman[70027]: 2024-09-12 02:11:02.786030214 +0000 UTC m=+0.354026296 container start 91c68dca1a8f125e5cba00161229febb56376f4d083d620a7d2e27afe58187d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:03.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:02 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:02.772+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:03.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:02 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:02.772+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:03.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:02 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:02.772+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:03.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:02 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:02.772+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:03.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:02 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:02.772+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:03.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:02 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:02.772+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:03.260 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:02 smithi189 podman[70027]: 2024-09-12 02:11:02.882885867 +0000 UTC m=+0.450881958 container attach 91c68dca1a8f125e5cba00161229febb56376f4d083d620a7d2e27afe58187d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T02:11:03.260 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 02:11:02 smithi189 podman[70027]: 2024-09-12 02:11:02.975244213 +0000 UTC m=+0.543240295 container died 91c68dca1a8f125e5cba00161229febb56376f4d083d620a7d2e27afe58187d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:11:03.544 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:03 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:03.264+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:03.544 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:03 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:03.264+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:03.544 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:03 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:03.264+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:03.544 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:03 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:03.264+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:03.544 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:03 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:03.264+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:03.545 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:03 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:03.264+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:03.563 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T02:11:03.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:03.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:03.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:03.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:03.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:03.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:03.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:03.603 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T02:11:03.603 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T02:11:03.603 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.9 2024-09-12T02:11:03.921 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 systemd[1]: Stopping Ceph osd.9 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:04.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:03 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:03.752+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:04.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:03 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:03.752+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:04.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:03 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:03.752+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:04.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:03 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:03.752+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:04.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:03 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:03.752+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:04.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:03 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:03.752+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:04.195 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.921+0000 7ff11afda640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.921+0000 7ff11afda640 -1 osd.9 85 *** Got signal Terminated *** 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:03 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:03.921+0000 7ff11afda640 -1 osd.9 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:04 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:04.196+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:04 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:04.196+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:04 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:04.196+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:04 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:04.196+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:04 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:04.196+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:04.196 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:04 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:04.196+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:04.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:04 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:04.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:04.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:04 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:04.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:04.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:04 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:04.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:04.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:04 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:04.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:04.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:04 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:04.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:04.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:04 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:04.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:05.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:04 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:04.782+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:05.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:04 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:04.782+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:05.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:04 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:04.782+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:05.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:04 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:04.782+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:05.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:04 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:04.782+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:05.151 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:04 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:04.782+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:05.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:05 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:05.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:05.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:05 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:05.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:05.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:05 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:05.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:05.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:05 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:05.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:05.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:05 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:05.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:05.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:05 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:05.218+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:05.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:05 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:05.316+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:05.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:05 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:05.316+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:05.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:05 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:05.316+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:05.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:05 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:05.316+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:05.594 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:05 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:05.316+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:05.594 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:05 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:05.316+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:06.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:05 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:05.830+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:06.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:05 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:05.830+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:06.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:05 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:05.830+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:06.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:05 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:05.830+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:06.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:05 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:05.830+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:06.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:05 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:05.830+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:06.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:06 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:06.242+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:06.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:06 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:06.242+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:06.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:06 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:06.242+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:06.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:06 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:06.242+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:06.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:06 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:06.242+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:06.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:06 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:06.242+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:06.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:06.310+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:06.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:06.310+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:06.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:06.310+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:06.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:06.310+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:06.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:06.310+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:06.594 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:06.310+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:07.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:06 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:06.835+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:07.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:06 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:06.835+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:07.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:06 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:06.835+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:07.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:06 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:06.835+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:07.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:06 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:06.835+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:07.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:06 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:06.835+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:07.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:07 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:07.271+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:07.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:07 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:07.271+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:07.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:07 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:07.271+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:07.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:07 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:07.271+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:07.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:07 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:07.271+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:07.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:07 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:07.271+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:07.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:07 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:07.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:07.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:07 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:07.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:07.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:07 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:07.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:07.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:07 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:07.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:07.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:07 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:07.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:07.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:07 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:07.298+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:08.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:07.863+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:08.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:07.863+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:08.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:07.863+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:08.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:07.863+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:08.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:07.863+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:08.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:07.863+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:08.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:07 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:07.863+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:08.568 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:08 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:08.298+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:57.673538+0000 front 2024-09-12T02:09:57.673635+0000 (oldest deadline 2024-09-12T02:10:19.373710+0000) 2024-09-12T02:11:08.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:08 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:08.298+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:05.274839+0000 front 2024-09-12T02:10:05.275041+0000 (oldest deadline 2024-09-12T02:10:31.174798+0000) 2024-09-12T02:11:08.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:08 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:08.298+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.175385+0000 front 2024-09-12T02:10:11.175398+0000 (oldest deadline 2024-09-12T02:10:37.075379+0000) 2024-09-12T02:11:08.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:08 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:08.298+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:21.776019+0000 front 2024-09-12T02:10:21.776205+0000 (oldest deadline 2024-09-12T02:10:47.676176+0000) 2024-09-12T02:11:08.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:08 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:08.298+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:28.777222+0000 front 2024-09-12T02:10:28.777239+0000 (oldest deadline 2024-09-12T02:10:51.677196+0000) 2024-09-12T02:11:08.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:08 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:08.298+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.078810+0000 front 2024-09-12T02:10:35.078690+0000 (oldest deadline 2024-09-12T02:10:59.178618+0000) 2024-09-12T02:11:08.569 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:08 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9[65047]: 2024-09-12T02:11:08.298+0000 7ff1135d7640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:44.479686+0000 front 2024-09-12T02:10:44.479658+0000 (oldest deadline 2024-09-12T02:11:07.379664+0000) 2024-09-12T02:11:08.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:08 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:08.267+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:08.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:08 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:08.267+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:08.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:08 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:08.267+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:08.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:08 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:08.267+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:08.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:08 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:08.267+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:08.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:08 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:08.267+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:09.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:08 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:08.885+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:09.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:08 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:08.885+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:09.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:08 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:08.885+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:09.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:08 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:08.885+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:09.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:08 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:08.885+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:09.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:08 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:08.885+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:09.150 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:08 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:08.885+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:09.494 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:09.227+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:09.562 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:09.227+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:09.562 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:09.227+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:09.562 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:09.227+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:09.562 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:09.227+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:09.562 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:09 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:09.227+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:09.563 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:09 smithi100 podman[91855]: 2024-09-12 02:11:09.225517534 +0000 UTC m=+5.421976474 container stop 3c37a23ab926fd87f8f39c25bb7fc723876353315e4298bc9723c28a79e43d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:09.563 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:09 smithi100 podman[91855]: 2024-09-12 02:11:09.251165788 +0000 UTC m=+5.447624720 container died 3c37a23ab926fd87f8f39c25bb7fc723876353315e4298bc9723c28a79e43d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:11:09.813 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:09 smithi100 podman[91855]: 2024-09-12 02:11:09.653777844 +0000 UTC m=+5.850236837 container cleanup 3c37a23ab926fd87f8f39c25bb7fc723876353315e4298bc9723c28a79e43d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T02:11:09.813 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:09 smithi100 bash[91855]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9 2024-09-12T02:11:10.068 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:09 smithi100 podman[91872]: 2024-09-12 02:11:09.813415935 +0000 UTC m=+0.578991306 container remove 3c37a23ab926fd87f8f39c25bb7fc723876353315e4298bc9723c28a79e43d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T02:11:10.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:09.900+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:10.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:09.900+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:10.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:09.900+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:10.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:09.900+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:10.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:09.900+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:10.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:09.900+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:10.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:09 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:09.900+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:10.524 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:10 smithi100 podman[91958]: 2024-09-12 02:11:10.114966341 +0000 UTC m=+0.015858018 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:10.524 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:10 smithi100 podman[91958]: 2024-09-12 02:11:10.222539024 +0000 UTC m=+0.123430749 container create 5c838cf88b5266c2b86b108928620918dd7fa0971ae5aea09320ae9a05fa74df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:11:10.524 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:10 smithi100 podman[91958]: 2024-09-12 02:11:10.441331234 +0000 UTC m=+0.342222910 container init 5c838cf88b5266c2b86b108928620918dd7fa0971ae5aea09320ae9a05fa74df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:11:10.524 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:10 smithi100 podman[91958]: 2024-09-12 02:11:10.444700539 +0000 UTC m=+0.345592220 container start 5c838cf88b5266c2b86b108928620918dd7fa0971ae5aea09320ae9a05fa74df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:11:10.524 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:10 smithi100 podman[91958]: 2024-09-12 02:11:10.524898076 +0000 UTC m=+0.425789772 container attach 5c838cf88b5266c2b86b108928620918dd7fa0971ae5aea09320ae9a05fa74df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:10.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:10.231+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:10.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:10.231+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:10.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:10.231+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:10.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:10.231+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:10.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:10.231+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:10.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:10.231+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:10.819 INFO:journalctl@ceph.osd.9.smithi100.stdout:Sep 12 02:11:10 smithi100 podman[91958]: 2024-09-12 02:11:10.631488943 +0000 UTC m=+0.532380624 container died 5c838cf88b5266c2b86b108928620918dd7fa0971ae5aea09320ae9a05fa74df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:11:11.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T02:11:11.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:11.328 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T02:11:11.328 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T02:11:11.328 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.10 2024-09-12T02:11:11.356 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:10 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:10.930+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:11.356 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:10 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:10.930+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:11.356 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:10 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:10.930+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:11.356 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:10 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:10.930+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:11.356 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:10 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:10.930+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:11.356 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:10 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:10.930+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:11.356 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:10 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:10.930+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:11.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:11 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:11.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:11.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:11 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:11.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:11.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:11 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:11.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:11.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:11 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:11.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:11.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:11 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:11.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:11.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:11 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:11.271+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:11.619 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 systemd[1]: Stopping Ceph osd.10 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:11.899 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.619+0000 7f795cefe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:11.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.619+0000 7f795cefe640 -1 osd.10 85 *** Got signal Terminated *** 2024-09-12T02:11:11.900 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.619+0000 7f795cefe640 -1 osd.10 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:12.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.972+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:12.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.972+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:12.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.972+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:12.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.972+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:12.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.972+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:12.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.972+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:12.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:11 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:11.972+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:12.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:12 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:12.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:12.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:12 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:12.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:12.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:12 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:12.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:12.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:12 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:12.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:12.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:12 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:12.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:12.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:12 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:12.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:13.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:12.973+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:13.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:12.973+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:13.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:12.973+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:13.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:12.973+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:13.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:12.973+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:13.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:12.973+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:13.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:12 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:12.973+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:13.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:13 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:13.265+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:13.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:13 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:13.265+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:13.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:13 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:13.265+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:13.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:13 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:13.265+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:13.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:13 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:13.265+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:13.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:13 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:13.265+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:14.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:13 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:13.985+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:14.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:13 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:13.985+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:14.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:13 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:13.985+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:14.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:13 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:13.985+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:14.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:13 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:13.985+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:14.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:13 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:13.985+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:14.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:13 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:13.985+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:14.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:14.281+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:14.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:14.281+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:14.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:14.281+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:14.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:14.281+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:14.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:14.281+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:14.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:14.281+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:15.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:15 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:15.013+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:15.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:15 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:15.013+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:15.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:15 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:15.013+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:15.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:15 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:15.013+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:15.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:15 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:15.013+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:15.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:15 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:15.013+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:15.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:15 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:15.013+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:15.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:15 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:15.324+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:15.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:15 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:15.324+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:15.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:15 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:15.324+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:15.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:15 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:15.324+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:15.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:15 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:15.324+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:15.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:15 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:15.324+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:16.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:16 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:16.035+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.220286+0000 front 2024-09-12T02:09:54.220298+0000 (oldest deadline 2024-09-12T02:10:18.920154+0000) 2024-09-12T02:11:16.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:16 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:16.035+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.521327+0000 front 2024-09-12T02:10:03.521346+0000 (oldest deadline 2024-09-12T02:10:29.421498+0000) 2024-09-12T02:11:16.400 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:16 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:16.035+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:12.922449+0000 front 2024-09-12T02:10:12.922594+0000 (oldest deadline 2024-09-12T02:10:35.822488+0000) 2024-09-12T02:11:16.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:16 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:16.035+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.523533+0000 front 2024-09-12T02:10:20.523462+0000 (oldest deadline 2024-09-12T02:10:44.623386+0000) 2024-09-12T02:11:16.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:16 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:16.035+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:25.124107+0000 front 2024-09-12T02:10:25.124075+0000 (oldest deadline 2024-09-12T02:10:51.024152+0000) 2024-09-12T02:11:16.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:16 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:16.035+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:37.425775+0000 front 2024-09-12T02:10:37.425900+0000 (oldest deadline 2024-09-12T02:11:01.525736+0000) 2024-09-12T02:11:16.401 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:16 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10[60668]: 2024-09-12T02:11:16.035+0000 7f7959503640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.100:6822 osd.6 since back 2024-09-12T02:10:43.226773+0000 front 2024-09-12T02:10:43.226739+0000 (oldest deadline 2024-09-12T02:11:07.326545+0000) 2024-09-12T02:11:16.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:16.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:16.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:16.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:16.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:16.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:16.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:16.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:16.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:16.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:16.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:16.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:16.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:16 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:16.287+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:17.277 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:17 smithi117 podman[69631]: 2024-09-12 02:11:17.023174194 +0000 UTC m=+5.501833176 container died 0bc5b20aa7e68ddc366741ba1aeb215aaa7b0a5b8c1293ce7f6b194c5fbdf499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T02:11:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:17.306+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:17.306+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:17.306+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:17.306+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:17.306+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:17.306+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:17.593 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:17 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:17.306+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:17.635 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:17 smithi117 podman[69631]: 2024-09-12 02:11:17.376671438 +0000 UTC m=+5.855330419 container cleanup 0bc5b20aa7e68ddc366741ba1aeb215aaa7b0a5b8c1293ce7f6b194c5fbdf499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:11:17.636 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:17 smithi117 bash[69631]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10 2024-09-12T02:11:17.899 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:17 smithi117 podman[69646]: 2024-09-12 02:11:17.636166797 +0000 UTC m=+0.610811892 container remove 0bc5b20aa7e68ddc366741ba1aeb215aaa7b0a5b8c1293ce7f6b194c5fbdf499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T02:11:18.272 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:17 smithi117 podman[69735]: 2024-09-12 02:11:17.978652853 +0000 UTC m=+0.097325673 container create a7bb44afa742992ac9a5a35e0e7618dae45e9138994e3af782442884be74c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:18.272 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:17 smithi117 podman[69735]: 2024-09-12 02:11:17.896990385 +0000 UTC m=+0.015663200 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:18.272 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:18 smithi117 podman[69735]: 2024-09-12 02:11:18.197631284 +0000 UTC m=+0.316304096 container init a7bb44afa742992ac9a5a35e0e7618dae45e9138994e3af782442884be74c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:18.272 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:18 smithi117 podman[69735]: 2024-09-12 02:11:18.200799281 +0000 UTC m=+0.319472093 container start a7bb44afa742992ac9a5a35e0e7618dae45e9138994e3af782442884be74c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:11:18.272 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:18 smithi117 podman[69735]: 2024-09-12 02:11:18.272608655 +0000 UTC m=+0.391281477 container attach a7bb44afa742992ac9a5a35e0e7618dae45e9138994e3af782442884be74c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:11:18.650 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 12 02:11:18 smithi117 podman[69735]: 2024-09-12 02:11:18.399503775 +0000 UTC m=+0.518176593 container died a7bb44afa742992ac9a5a35e0e7618dae45e9138994e3af782442884be74c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T02:11:18.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:18.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:18.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:18.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:18.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:18.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:18.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:18.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:18.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:18.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:18.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:18.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:18.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:18 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:18.355+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:18.963 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T02:11:19.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:19.047 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T02:11:19.047 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T02:11:19.047 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.11 2024-09-12T02:11:19.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 systemd[1]: Stopping Ceph osd.11 for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:19.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.347+0000 7fbe24335640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:19.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.347+0000 7fbe24335640 -1 osd.11 85 *** Got signal Terminated *** 2024-09-12T02:11:19.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.347+0000 7fbe24335640 -1 osd.11 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:19.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.385+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:19.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.385+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:19.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.385+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:19.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.385+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:19.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.385+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:19.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.385+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:19.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:19 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:19.385+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:20.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:20.377+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:20.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:20.377+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:20.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:20.377+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:20.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:20.377+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:20.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:20.377+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:20.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:20.377+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:20.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:20 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:20.377+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:21.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:21.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:21.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:21.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:21.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:21.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:21.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:21.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:21.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:21.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:21.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:21.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:21.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:21 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:21.411+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:22.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:22.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:22.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:22.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:22.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:22.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:22.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:22.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:22.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:22.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:22.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:22.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:22.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:22 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:22.372+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-12T02:09:54.545297+0000 front 2024-09-12T02:09:54.545362+0000 (oldest deadline 2024-09-12T02:10:20.445320+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-12T02:10:03.346702+0000 front 2024-09-12T02:10:03.346688+0000 (oldest deadline 2024-09-12T02:10:28.046333+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T02:10:11.547140+0000 front 2024-09-12T02:10:11.547198+0000 (oldest deadline 2024-09-12T02:10:34.447259+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.100:6814 osd.3 since back 2024-09-12T02:10:20.649579+0000 front 2024-09-12T02:10:20.649524+0000 (oldest deadline 2024-09-12T02:10:42.949542+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6812 osd.4 since back 2024-09-12T02:10:29.351036+0000 front 2024-09-12T02:10:29.351151+0000 (oldest deadline 2024-09-12T02:10:51.551456+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T02:10:35.052120+0000 front 2024-09-12T02:10:35.052189+0000 (oldest deadline 2024-09-12T02:11:00.952186+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.117:6820 osd.7 since back 2024-09-12T02:10:52.654027+0000 front 2024-09-12T02:10:52.654047+0000 (oldest deadline 2024-09-12T02:11:15.554034+0000) 2024-09-12T02:11:23.843 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:23 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11[61020]: 2024-09-12T02:11:23.392+0000 7fbe2093a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-12T02:10:56.654676+0000 front 2024-09-12T02:10:56.654657+0000 (oldest deadline 2024-09-12T02:11:22.554836+0000) 2024-09-12T02:11:25.001 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:24 smithi189 podman[70143]: 2024-09-12 02:11:24.691131744 +0000 UTC m=+5.447706741 container died 6dcf6fe5d20d6e895d388c70dc2a6c38accdca21e8046ce0e6d597a7b03d3dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:11:25.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:25 smithi189 podman[70143]: 2024-09-12 02:11:25.088462721 +0000 UTC m=+5.845037705 container cleanup 6dcf6fe5d20d6e895d388c70dc2a6c38accdca21e8046ce0e6d597a7b03d3dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:11:25.344 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:25 smithi189 bash[70143]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11 2024-09-12T02:11:25.709 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:25 smithi189 podman[70159]: 2024-09-12 02:11:25.398174771 +0000 UTC m=+0.695901003 container remove 6dcf6fe5d20d6e895d388c70dc2a6c38accdca21e8046ce0e6d597a7b03d3dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:11:26.034 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:25 smithi189 podman[70247]: 2024-09-12 02:11:25.612131213 +0000 UTC m=+0.015819201 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:26.034 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:25 smithi189 podman[70247]: 2024-09-12 02:11:25.732304554 +0000 UTC m=+0.135992518 container create de10fbe863c9c58a8e00be19e8402c86622443edb45ee356ffac03b9695de496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T02:11:26.034 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:25 smithi189 podman[70247]: 2024-09-12 02:11:25.951496418 +0000 UTC m=+0.355184402 container init de10fbe863c9c58a8e00be19e8402c86622443edb45ee356ffac03b9695de496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:11:26.035 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:25 smithi189 podman[70247]: 2024-09-12 02:11:25.954847405 +0000 UTC m=+0.358535371 container start de10fbe863c9c58a8e00be19e8402c86622443edb45ee356ffac03b9695de496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T02:11:26.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:26 smithi189 podman[70247]: 2024-09-12 02:11:26.034489591 +0000 UTC m=+0.438177565 container attach de10fbe863c9c58a8e00be19e8402c86622443edb45ee356ffac03b9695de496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T02:11:26.343 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 02:11:26 smithi189 podman[70247]: 2024-09-12 02:11:26.143040718 +0000 UTC m=+0.546728686 container died de10fbe863c9c58a8e00be19e8402c86622443edb45ee356ffac03b9695de496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:26.694 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T02:11:26.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:26.733 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T02:11:26.734 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T02:11:26.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.a 2024-09-12T02:11:27.039 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:26 smithi100 systemd[1]: Stopping Ceph mds.a for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:27.318 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:27 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a[71810]: 2024-09-12T02:11:27.038+0000 7f237be82640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:27.318 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:27 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a[71810]: 2024-09-12T02:11:27.038+0000 7f237be82640 -1 mds.a *** got signal Terminated *** 2024-09-12T02:11:30.747 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:30 smithi100 podman[92077]: 2024-09-12 02:11:30.40364252 +0000 UTC m=+3.472435439 container died 3627d61471d62c94c59c5e8cc448bcd10b264f1d501b3ec49aceccefb8688d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:31.069 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:30 smithi100 podman[92077]: 2024-09-12 02:11:30.963418814 +0000 UTC m=+4.032211732 container cleanup 3627d61471d62c94c59c5e8cc448bcd10b264f1d501b3ec49aceccefb8688d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:11:31.069 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:30 smithi100 bash[92077]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a 2024-09-12T02:11:31.388 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T02:11:31.410 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:31 smithi100 podman[92091]: 2024-09-12 02:11:31.156563097 +0000 UTC m=+0.754028703 container remove 3627d61471d62c94c59c5e8cc448bcd10b264f1d501b3ec49aceccefb8688d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:11:31.410 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:31 smithi100 systemd[1]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-12T02:11:31.410 INFO:journalctl@ceph.mds.a.smithi100.stdout:Sep 12 02:11:31 smithi100 systemd[1]: Stopped Ceph mds.a for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:11:31.424 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:31.424 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T02:11:31.425 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T02:11:31.425 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.d 2024-09-12T02:11:31.742 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:11:31 smithi100 systemd[1]: Stopping Ceph mds.d for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:32.068 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:11:31 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d[70618]: 2024-09-12T02:11:31.742+0000 7f32d7c5f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:32.068 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:11:31 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d[70618]: 2024-09-12T02:11:31.742+0000 7f32d7c5f640 -1 mds.d *** got signal Terminated *** 2024-09-12T02:11:36.069 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:11:35 smithi100 podman[92200]: 2024-09-12 02:11:35.755070891 +0000 UTC m=+4.118186971 container died 37ac9312cbbc3f4075ace3c5a61fc09787cd6fce20b16a8aa229ed6531398e19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:11:36.385 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:11:36 smithi100 podman[92200]: 2024-09-12 02:11:36.108972895 +0000 UTC m=+4.472088973 container cleanup 37ac9312cbbc3f4075ace3c5a61fc09787cd6fce20b16a8aa229ed6531398e19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T02:11:36.385 INFO:journalctl@ceph.mds.d.smithi100.stdout:Sep 12 02:11:36 smithi100 bash[92200]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-d 2024-09-12T02:11:36.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T02:11:36.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:36.567 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T02:11:36.567 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T02:11:36.567 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.g 2024-09-12T02:11:37.068 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:11:36 smithi100 systemd[1]: Stopping Ceph mds.g for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:37.069 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:11:36 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g[71391]: 2024-09-12T02:11:36.887+0000 7f32eb53a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:37.069 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:11:36 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g[71391]: 2024-09-12T02:11:36.887+0000 7f32eb53a640 -1 mds.g *** got signal Terminated *** 2024-09-12T02:11:39.179 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:11:38 smithi100 podman[92324]: 2024-09-12 02:11:38.90230162 +0000 UTC m=+2.114179354 container died 436c8e523b0cd48ede898e3bd52ac8db746976c04463086d515b08c33408ed13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:39.568 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:11:39 smithi100 podman[92324]: 2024-09-12 02:11:39.363153245 +0000 UTC m=+2.575031018 container cleanup 436c8e523b0cd48ede898e3bd52ac8db746976c04463086d515b08c33408ed13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:39.569 INFO:journalctl@ceph.mds.g.smithi100.stdout:Sep 12 02:11:39 smithi100 bash[92324]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-g 2024-09-12T02:11:39.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T02:11:39.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:39.820 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T02:11:39.820 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T02:11:39.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.j 2024-09-12T02:11:40.133 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:11:39 smithi100 systemd[1]: Stopping Ceph mds.j for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:40.569 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:11:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j[70226]: 2024-09-12T02:11:40.133+0000 7f58ddc78640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:40.569 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:11:40 smithi100 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j[70226]: 2024-09-12T02:11:40.133+0000 7f58ddc78640 -1 mds.j *** got signal Terminated *** 2024-09-12T02:11:44.408 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:11:44 smithi100 podman[92444]: 2024-09-12 02:11:44.142671142 +0000 UTC m=+4.098448087 container died 6c5eebf8ab2eb3a0f002cf0d1a813df110688d69c9edbf7accf00e8adc4f0de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:11:44.818 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:11:44 smithi100 podman[92444]: 2024-09-12 02:11:44.599941711 +0000 UTC m=+4.555718656 container cleanup 6c5eebf8ab2eb3a0f002cf0d1a813df110688d69c9edbf7accf00e8adc4f0de2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:44.819 INFO:journalctl@ceph.mds.j.smithi100.stdout:Sep 12 02:11:44 smithi100 bash[92444]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-j 2024-09-12T02:11:45.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T02:11:45.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:45.056 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T02:11:45.056 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T02:11:45.057 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.b 2024-09-12T02:11:45.400 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:11:45 smithi117 systemd[1]: Stopping Ceph mds.b for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:45.664 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:11:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: 2024-09-12T02:11:45.448+0000 7f0cc52e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:45.664 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:11:45 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b[66029]: 2024-09-12T02:11:45.448+0000 7f0cc52e7640 -1 mds.b *** got signal Terminated *** 2024-09-12T02:11:49.515 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:11:49 smithi117 podman[69839]: 2024-09-12 02:11:49.177886433 +0000 UTC m=+3.918308282 container died ed4b3baae4f406e569fde5d1dd6ac1d9246bb4920812fb4e2af1ba652edd5e92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:49.807 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:11:49 smithi117 podman[69839]: 2024-09-12 02:11:49.614968395 +0000 UTC m=+4.355390243 container cleanup ed4b3baae4f406e569fde5d1dd6ac1d9246bb4920812fb4e2af1ba652edd5e92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:11:49.807 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 12 02:11:49 smithi117 bash[69839]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-b 2024-09-12T02:11:50.030 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T02:11:50.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:50.067 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T02:11:50.067 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T02:11:50.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.e 2024-09-12T02:11:50.385 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:11:50 smithi117 systemd[1]: Stopping Ceph mds.e for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:50.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:11:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e[65429]: 2024-09-12T02:11:50.385+0000 7f9937442640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:50.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:11:50 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e[65429]: 2024-09-12T02:11:50.385+0000 7f9937442640 -1 mds.e *** got signal Terminated *** 2024-09-12T02:11:53.650 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:11:53 smithi117 podman[69972]: 2024-09-12 02:11:53.17727611 +0000 UTC m=+2.885312730 container died 14154e07bc81336436d0dc9bb52c90d4198d483e762c18e67194d9764bb2b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:11:54.010 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:11:53 smithi117 podman[69972]: 2024-09-12 02:11:53.743116702 +0000 UTC m=+3.451153323 container cleanup 14154e07bc81336436d0dc9bb52c90d4198d483e762c18e67194d9764bb2b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T02:11:54.010 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 12 02:11:53 smithi117 bash[69972]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-e 2024-09-12T02:11:54.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T02:11:54.211 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:54.211 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T02:11:54.211 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T02:11:54.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.h 2024-09-12T02:11:54.650 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:11:54 smithi117 systemd[1]: Stopping Ceph mds.h for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:54.650 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:11:54 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h[65728]: 2024-09-12T02:11:54.521+0000 7fdb9dc05640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:54.650 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:11:54 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h[65728]: 2024-09-12T02:11:54.521+0000 7fdb9dc05640 -1 mds.h *** got signal Terminated *** 2024-09-12T02:11:57.464 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:11:57 smithi117 podman[70091]: 2024-09-12 02:11:57.181288184 +0000 UTC m=+2.746478709 container died 07958c8f856c8f5f9ffbfbf86cb2109996ae7eda5635bb466627c71039fb5a1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:11:57.772 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:11:57 smithi117 podman[70091]: 2024-09-12 02:11:57.55482059 +0000 UTC m=+3.120011105 container cleanup 07958c8f856c8f5f9ffbfbf86cb2109996ae7eda5635bb466627c71039fb5a1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:11:57.772 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 12 02:11:57 smithi117 bash[70091]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-h 2024-09-12T02:11:57.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T02:11:57.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:57.950 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T02:11:57.950 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T02:11:57.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.k 2024-09-12T02:11:58.400 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:11:58 smithi117 systemd[1]: Stopping Ceph mds.k for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:11:58.400 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:11:58 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k[65116]: 2024-09-12T02:11:58.266+0000 7f55dc76e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:58.400 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:11:58 smithi117 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k[65116]: 2024-09-12T02:11:58.266+0000 7f55dc76e640 -1 mds.k *** got signal Terminated *** 2024-09-12T02:12:01.533 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:12:01 smithi117 podman[70214]: 2024-09-12 02:12:01.277970777 +0000 UTC m=+3.105765600 container died 36bbe14017a520f2abdd00d3489787628b0e8a6e0ec8b9f5e276e6d79e79e56d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:12:01.791 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:12:01 smithi117 podman[70214]: 2024-09-12 02:12:01.624525314 +0000 UTC m=+3.452320133 container cleanup 36bbe14017a520f2abdd00d3489787628b0e8a6e0ec8b9f5e276e6d79e79e56d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:12:01.791 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:12:01 smithi117 bash[70214]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k 2024-09-12T02:12:02.034 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T02:12:02.055 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:12:01 smithi117 podman[70226]: 2024-09-12 02:12:01.791899672 +0000 UTC m=+0.509483562 container remove 36bbe14017a520f2abdd00d3489787628b0e8a6e0ec8b9f5e276e6d79e79e56d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:12:02.055 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:12:02 smithi117 systemd[1]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-12T02:12:02.055 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 12 02:12:02 smithi117 systemd[1]: Stopped Ceph mds.k for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:12:02.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:02.065 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T02:12:02.066 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T02:12:02.066 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.c 2024-09-12T02:12:02.593 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:12:02 smithi189 systemd[1]: Stopping Ceph mds.c for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:12:03.093 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:12:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c[66165]: 2024-09-12T02:12:02.636+0000 7fad122cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:03.093 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:12:02 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c[66165]: 2024-09-12T02:12:02.636+0000 7fad122cd640 -1 mds.c *** got signal Terminated *** 2024-09-12T02:12:05.461 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:12:05 smithi189 podman[70348]: 2024-09-12 02:12:05.18929168 +0000 UTC m=+2.929798390 container died 71f315c27e5a3536c97317ea46b865e1c6e5620ebb34d5df4bc5263bb0626b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:12:05.820 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:12:05 smithi189 podman[70348]: 2024-09-12 02:12:05.569625424 +0000 UTC m=+3.310132133 container cleanup 71f315c27e5a3536c97317ea46b865e1c6e5620ebb34d5df4bc5263bb0626b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:12:05.820 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 02:12:05 smithi189 bash[70348]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-c 2024-09-12T02:12:05.957 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T02:12:05.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:05.990 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T02:12:05.990 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T02:12:05.990 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.f 2024-09-12T02:12:06.093 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:12:06 smithi189 systemd[1]: Stopping Ceph mds.f for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:12:06.593 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:12:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f[65865]: 2024-09-12T02:12:06.307+0000 7f3b14f91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:06.593 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:12:06 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f[65865]: 2024-09-12T02:12:06.307+0000 7f3b14f91640 -1 mds.f *** got signal Terminated *** 2024-09-12T02:12:09.456 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:12:09 smithi189 podman[70470]: 2024-09-12 02:12:09.17612223 +0000 UTC m=+2.972674280 container died 4a88eac77cc3671466b0e8052d331539d2edc65597d97a923f954f0d660bc385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T02:12:09.815 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:12:09 smithi189 podman[70470]: 2024-09-12 02:12:09.54009422 +0000 UTC m=+3.336646266 container cleanup 4a88eac77cc3671466b0e8052d331539d2edc65597d97a923f954f0d660bc385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:12:09.816 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 02:12:09 smithi189 bash[70470]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-f 2024-09-12T02:12:09.962 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T02:12:09.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:09.995 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T02:12:09.996 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T02:12:09.996 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.i 2024-09-12T02:12:10.343 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:10 smithi189 systemd[1]: Stopping Ceph mds.i for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:12:10.343 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i[66466]: 2024-09-12T02:12:10.309+0000 7f024e2b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:10.343 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:10 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i[66466]: 2024-09-12T02:12:10.309+0000 7f024e2b7640 -1 mds.i *** got signal Terminated *** 2024-09-12T02:12:13.535 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:13 smithi189 podman[70593]: 2024-09-12 02:12:13.186898104 +0000 UTC m=+2.966064299 container died aa2da3149152ddffffd8547ca70a27fe2e82b6095ff8124da66e714ff9d027b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True) 2024-09-12T02:12:13.802 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:13 smithi189 podman[70593]: 2024-09-12 02:12:13.618363537 +0000 UTC m=+3.397529774 container cleanup aa2da3149152ddffffd8547ca70a27fe2e82b6095ff8124da66e714ff9d027b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T02:12:13.802 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:13 smithi189 bash[70593]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i 2024-09-12T02:12:14.046 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T02:12:14.067 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:13 smithi189 podman[70605]: 2024-09-12 02:12:13.802664424 +0000 UTC m=+0.615397590 container remove aa2da3149152ddffffd8547ca70a27fe2e82b6095ff8124da66e714ff9d027b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T02:12:14.067 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:14 smithi189 systemd[1]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-12T02:12:14.068 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:14 smithi189 systemd[1]: Stopped Ceph mds.i for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:12:14.068 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 02:12:14 smithi189 systemd[1]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.i.service: Consumed 1.380s CPU time. 2024-09-12T02:12:14.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:14.078 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T02:12:14.078 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T02:12:14.079 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.l 2024-09-12T02:12:14.343 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:14 smithi189 systemd[1]: Stopping Ceph mds.l for 3a2902f2-70aa-11ef-bcea-c7b262605968... 2024-09-12T02:12:14.843 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l[65560]: 2024-09-12T02:12:14.421+0000 7f0cbcc6e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:14.843 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:14 smithi189 ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l[65560]: 2024-09-12T02:12:14.421+0000 7f0cbcc6e640 -1 mds.l *** got signal Terminated *** 2024-09-12T02:12:18.822 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:18 smithi189 podman[70713]: 2024-09-12 02:12:18.436180584 +0000 UTC m=+4.135895790 container died 2ccae9915985b284b88bf19c61236b3b1e501a46003bbcb4206b5d22042caa10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T02:12:19.073 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:18 smithi189 podman[70713]: 2024-09-12 02:12:18.905431759 +0000 UTC m=+4.605146972 container cleanup 2ccae9915985b284b88bf19c61236b3b1e501a46003bbcb4206b5d22042caa10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:12:19.073 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:18 smithi189 bash[70713]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l 2024-09-12T02:12:19.074 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:19 smithi189 podman[70728]: 2024-09-12 02:12:19.073031992 +0000 UTC m=+0.637053549 container remove 2ccae9915985b284b88bf19c61236b3b1e501a46003bbcb4206b5d22042caa10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-3a2902f2-70aa-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T02:12:19.313 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T02:12:19.334 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:19 smithi189 systemd[1]: ceph-3a2902f2-70aa-11ef-bcea-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-12T02:12:19.334 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 02:12:19 smithi189 systemd[1]: Stopped Ceph mds.l for 3a2902f2-70aa-11ef-bcea-c7b262605968. 2024-09-12T02:12:19.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:19.344 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T02:12:19.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:12:19.547 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T02:12:22.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:12:22.415 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T02:12:24.903 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:12:25.104 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T02:12:27.463 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:12:27.496 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:12:27.529 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:12:27.557 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T02:12:27.559 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi100/crash 2024-09-12T02:12:27.560 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:12:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:12:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:12:27.601 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi117/crash 2024-09-12T02:12:27.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:12:27.682 INFO:teuthology.orchestra.run.smithi117.stderr:tar: /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:12:27.682 INFO:teuthology.orchestra.run.smithi117.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:12:27.684 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi189/crash 2024-09-12T02:12:27.685 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:12:27.721 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:12:27.721 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:12:27.722 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T02:12:27.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T02:12:27.764 INFO:tasks.cephadm:Compressing logs... 2024-09-12T02:12:27.764 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:12:27.806 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:12:27.809 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:12:27.829 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T02:12:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:: No such file or directory 2024-09-12T02:12:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T02:12:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:12:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:12:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T02:12:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:12:27.834 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T02:12:27.834 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T02:12:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:12:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T02:12:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:12:27.835 INFO:teuthology.orchestra.run.smithi100.stderr: 90.2%/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.6.log: -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:12:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 94.7% --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T02:12:27.835 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T02:12:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T02:12:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T02:12:27.844 INFO:teuthology.orchestra.run.smithi100.stderr: 86.2% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:12:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T02:12:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T02:12:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T02:12:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:12:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.3.log: 94.8% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T02:12:27.847 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/cephadm.log: 90.9% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:12:27.851 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:: No such file or directory 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.11.log: 82.6%gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr: -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T02:12:27.852 INFO:teuthology.orchestra.run.smithi189.stderr: 90.4% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.5.log: /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.1% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr: 94.9% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.2% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T02:12:27.853 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.c.log: 90.9% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:: No such file or directory 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.b.log: /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:12:27.854 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log: 94.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr: 90.4% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip 82.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr: -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.y.log: /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log: 86.1% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.h.log: 92.1% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:12:27.855 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:12:27.856 INFO:teuthology.orchestra.run.smithi100.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:12:27.860 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:12:27.866 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:12:27.874 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:12:27.894 INFO:teuthology.orchestra.run.smithi189.stderr: 93.2% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T02:12:27.895 INFO:teuthology.orchestra.run.smithi189.stderr: 93.9% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T02:12:28.001 INFO:teuthology.orchestra.run.smithi189.stderr: 95.4% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T02:12:28.029 INFO:teuthology.orchestra.run.smithi189.stderr: 91.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T02:12:28.035 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T02:12:28.116 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T02:12:28.139 INFO:teuthology.orchestra.run.smithi117.stderr: 95.9% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T02:12:28.188 INFO:teuthology.orchestra.run.smithi100.stderr: 93.1% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T02:12:28.273 INFO:teuthology.orchestra.run.smithi189.stderr: 93.5% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T02:12:28.285 INFO:teuthology.orchestra.run.smithi189.stderr: 93.2% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T02:12:28.303 INFO:teuthology.orchestra.run.smithi189.stderr: 93.3% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T02:12:28.321 INFO:teuthology.orchestra.run.smithi100.stderr: 93.2% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T02:12:28.357 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T02:12:28.407 INFO:teuthology.orchestra.run.smithi189.stderr: 93.3% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T02:12:28.409 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-12T02:12:28.409 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m0.586s 2024-09-12T02:12:28.409 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m2.314s 2024-09-12T02:12:28.409 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.101s 2024-09-12T02:12:28.578 INFO:teuthology.orchestra.run.smithi100.stderr: 93.9% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T02:12:28.591 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T02:12:28.608 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T02:12:28.675 INFO:teuthology.orchestra.run.smithi117.stderr: 94.0% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T02:12:28.721 INFO:teuthology.orchestra.run.smithi117.stderr: 94.2% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T02:12:29.055 INFO:teuthology.orchestra.run.smithi117.stderr: 93.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T02:12:30.412 INFO:teuthology.orchestra.run.smithi117.stderr: 93.7% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T02:12:30.414 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-12T02:12:30.415 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m2.591s 2024-09-12T02:12:30.415 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m7.373s 2024-09-12T02:12:30.415 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.262s 2024-09-12T02:12:31.046 INFO:teuthology.orchestra.run.smithi100.stderr: 96.8% -- replaced with /var/log/ceph/3a2902f2-70aa-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T02:12:31.048 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-12T02:12:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m3.229s 2024-09-12T02:12:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m5.354s 2024-09-12T02:12:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.230s 2024-09-12T02:12:31.049 INFO:tasks.cephadm:Archiving logs... 2024-09-12T02:12:31.049 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi100/log 2024-09-12T02:12:31.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:12:31.736 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi117/log 2024-09-12T02:12:31.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:12:32.642 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi189/log 2024-09-12T02:12:32.643 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:12:32.984 INFO:tasks.cephadm:Removing cluster... 2024-09-12T02:12:32.985 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 --force 2024-09-12T02:12:33.185 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T02:12:33.446 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 --force 2024-09-12T02:12:33.655 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T02:12:33.916 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3a2902f2-70aa-11ef-bcea-c7b262605968 --force 2024-09-12T02:12:34.111 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 3a2902f2-70aa-11ef-bcea-c7b262605968 2024-09-12T02:12:34.377 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T02:12:34.377 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:12:34.395 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:12:34.411 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:12:34.427 INFO:tasks.cephadm:Teardown complete 2024-09-12T02:12:34.427 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:12:34.440 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:12:34.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:12:34.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:12:34.453 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:12:34.590 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:12:34.600 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:12:34.601 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:12:34.603 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:12:34.606 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:12:34.617 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:12:34.618 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:12:34.620 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:12:34.622 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:12:34.622 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T02:12:34.622 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 -2632us[-2679us] +/- 43ms 2024-09-12T02:12:34.622 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +1117us[+1070us] +/- 54ms 2024-09-12T02:12:34.622 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +3413us[+3366us] +/- 83ms 2024-09-12T02:12:34.622 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:12:34.624 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:12:34.624 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-12T02:12:34.624 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 -2634us[-2643us] +/- 43ms 2024-09-12T02:12:34.624 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +1094us[+1086us] +/- 54ms 2024-09-12T02:12:34.624 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +3427us[+3418us] +/- 83ms 2024-09-12T02:12:34.624 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:12:34.625 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:12:34.625 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-12T02:12:34.625 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 -2624us[-2639us] +/- 43ms 2024-09-12T02:12:34.625 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +1099us[+1084us] +/- 54ms 2024-09-12T02:12:34.625 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +3407us[+3407us] +/- 83ms 2024-09-12T02:12:34.626 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:12:34.626 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:12:34.636 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:12:34.636 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:12:34.647 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:12:34.744 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:12:34.809 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:12:34.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:12:34.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:34.908 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:12:34.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:34.936 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:12:34.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:34.965 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:12:34.977 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:12:34.989 INFO:teuthology.task.internal:Duration was 1307.854590 seconds 2024-09-12T02:12:34.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:12:35.000 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:12:35.001 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:12:35.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:12:35.007 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:12:35.043 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:12:35.043 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:12:35.046 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:12:35.437 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:12:35.437 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T02:12:35.437 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:12:35.459 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T02:12:35.459 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:12:35.500 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-12T02:12:35.501 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:12:35.527 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:12:35.528 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:12:35.530 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:12:35.543 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:12:35.595 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:12:35.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:12:35.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:12:35.610 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:12:36.233 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:12:36.247 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:12:36.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:12:36.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:12:36.299 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:12:36.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:12:36.363 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:36.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:36.368 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:36.387 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-12T02:12:36.390 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-12T02:12:36.392 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-12T02:12:36.425 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:36.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:36.456 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:36.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:36.480 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:36.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:36.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:12:36.506 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:12:36.507 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi100 2024-09-12T02:12:36.507 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:12:36.569 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi117 2024-09-12T02:12:36.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:12:36.607 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901581/remote/smithi189 2024-09-12T02:12:36.607 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:12:36.642 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:12:36.643 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:12:36.645 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:12:36.648 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:12:36.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:12:36.706 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:12:36.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:12:36.717 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:12:36.717 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:12:36.719 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:12:36.722 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:12:36.732 INFO:teuthology.orchestra.run.smithi100.stdout: 266054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:12 /home/ubuntu/cephtest 2024-09-12T02:12:36.734 INFO:teuthology.orchestra.run.smithi117.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:12 /home/ubuntu/cephtest 2024-09-12T02:12:36.748 INFO:teuthology.orchestra.run.smithi189.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:12 /home/ubuntu/cephtest 2024-09-12T02:12:36.749 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:12:36.762 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:12:36.789 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} duration: 1307.8545899391174 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:12:36.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:12:36.886 INFO:teuthology.run:pass